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PREFACE 


Recent  armed  conflicts  in  the  last  4  years  have  demonstrated  the 
superiority  of  weapons  systems  using  electro-optical  sensors  that  operate  in 
spectral  hands  throughout  the  ultraviolet  through  millimeter  wave  spectrum.  The 
performance  of  these  sensors  depends  on  countermeasures  effectiveness, 
atmospheric  conditions,  background  and  target  signatures,  and  the  sensor 
response  envelope.  Without  careful  specification  of  all  these  parameters  and 
variables,  the  probability  of  operational  success  for  systems  using  these  sensors  is 
unknown.  Range  Commanders  Coimcil  document  356-84,  Guidelines  for 
Atmospheric  Measurements  in  Support  of  Electro-Optical  Systems  Testing. 
provided  guidance  to  test  ranges  and  programs  for  acquiring  adequate  data  to 
specify  electro-optical  sensor  performance  under  a  range  of  atmospheric  conditions. 
The  pxirpose  of  this  report  is  to  update  RCC  document  356-84  in  view  of  modem 
test  and  evaluation  requirements  and  technological  advances  in  the  last  decade 
and  to  provide  guidelines  for  atmospheric  measiirements  used  to  support  test  and 
evaluation  of  electro-optical  sensor  system  performance.  The  guidelines  approach 
is  employed  to  illustrate  the  context  in  which  the  measurements  will  be  used,  to 
show  the  impact  of  measurement  error  on  measurement  applications,  and  to 
emphasize  that  atmospheric  measurements  are  an  interactive,  complex  set  of 
variables  that  must  be  viewed  as  a  whole. 

Demands  for  high  quality  atmospheric  measurements  to  support 
electro-optical  performance  evaluation  have  increased  during  the  past  10  years  for 
at  least  three  reasons. 

1.  It  is  impractical  to  test  electro-optical  sensor  performance  imder  all 
operational  atmospheric  conditions.  Thus,  electro-optical  sensor 
atmospheric  field  tests  produce  "calibration  points"  that  are  used  to  ensure 
models  predicting  system  performance  under  all  conditions  are  accurate  and 
that  the  sensor  fimctions  as  expected. 

2.  Field  test  data  now  serve  as  the  basis  for  the  development  of  simulations 
used  to  train  sensor  users. 

3.  The  number  of  test  ranges  supporting  electro-optical  testing  in  the 
atmosphere  and  the  budgets  for  testing  have  dramatically  decreased  in 
recent  years,  so  it  must  be  expected  that  each  data  point  now  acquired  will 
be  used  in  future  sensor  evaluation  and  design. 

A  focused  effort  encompassing  comprehensive  management  in  all  phases  of 
the  data  cycle  is  required  to  achieve  the  data  quahty  and  quantity  demanded  by 
current  sensor  test  and  evaluation,  simulation  developments,  and  future 
applications.  Total  Quahty  Data  Management  (TQDM)  is  the  approach  taken  by 
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these  gmdelines  to  attain  a  high  standard  of  data  quality.  The  objectives  of 
TQDM  are 

•  comprehensive  management  of  all  phases  of  the  data  cycle, 

•  continuous  measmable  improvement  in  aU  aspects  of  the  data  cycle, 

•  quantifiable  data  standards,  and 

•  accessible  data  and  information. 

These  guidelines  describe  how  TQDM  accomplishes  these  objectives  by  planning 

•  all  test  phases  in  accordance  with  instrmnentation  accuracy  capability 
and  required  final  product  accuracy, 

•  measurement  cross-checks  and  verifications, 

•  data  accuracy  determination, 

•  data  evaluation  and  archival,  and 

•  standardized  data  available  to  current  and  future  users  in  information 
base  formats. 

Every  test  program  is  unique;  however,  experience  shows  that  all  test 
programs  share  many  common  measurements.  To  illustrate,  these  guidelines 
discuss  measiu’ements  required  by  two  major  Army  electro-optical  test  programs: 
Smoke  Week  and  Smart  Weapons  Operational  Enhancement  (SWOE)  tests. 
Additionally,  measurements  for  specific  electro-optical  sensors  (multispectral 
imaging  systems  emd  laser  range  finder/designators)  used  by  all  military  services 
are  reviewed.  Topical  required  sampling  rates,  data  averaging  times,  and  a 
suggested  level  of  measxu-ement  accuracy  are  given.  As  the  user  of  this  document 
will  note,  the  specification  of  single  values  of  instrument  measurement  accuracy  is 
inappropriate  for  many  test  data  applications. 

General  information  guidelines  have  been  provided  for  desirable 
measurement  methods.  It  is  recognized  that,  in  many  cases,  measurements  at  a 
specific  range  must  be  made  with  existing  hardware;  however,  as  the  guidelines 
show,  many  previous  measurements  have  not  acquired  the  necessary  supporting 
data,  calibration  records  were  not  maintained,  and  measurement  errors  were  not 
determined.  Such  fundamental  requirements  are  the  focus  of  these  measurement 
method  guidelines. 

Data  evaluation  guidelines  are  also  provided.  Those  who  test  systems 
imderstand  best  the  hmitations  of  test  support  data.  Examination  of  existing 
atmospheric  data  bases  shows  that  measurement  errors  are  rarely  recorded  with 
the  data.  Data  acciiracy  and  methods  of  qualifying  data  must  be  acquired  and 
specified  as  a  normal  part  of  test  procedures  if  data  now  acquired  are  to  be  used 
effectively  in  futiu*e  electro-optical  system  evaluations  and  simulations. 
Determination  of  data  accuracy  by  the  method  of  root-mean-square  error  analysis 
is  reviewed  emd  recommended  as  a  means  of  qualifying  data.  Application  to 
sensors  employed  for  target  detection  and  ranging  and  multispectral 
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transmissometry  are  discussed  as  examples.  The  impact  of  spatial  and  temporal 
sampling  intervals  on  data  interpretation  is  shown  to  play  a  fundamental  role  in 
test  design  considerations. 

A  distinction  is  drawn  between  data  bases  (archived  data)  and  information 
bases  (summaries  of  results  from  data  applications).  Guidelines  are  provided  for 
developing  and  making  data  and  information  accessible.  In  many  cases,  users  do 
not  require  or  want  archived  data.  Their  interest  is  in  the  information  the  data 
yields.  Making  data  accessible  and  meaningful  through  information  bases 
developed  to  reside  with  the  archived  data  base  ensures  that  data  is  accessible  in 
an  immediately  useful  form.  Two  new  types  of  information  base  are  recommended 
for  test  range  operational  planning  and  use.  These  information  bases  are 
identification  of  data  gaps  and  tracking  of  anticipated  test  reqmrements.  With 
this  information,  test  designers  can  often  structure  tests  to  acquire  missing  data, 
and  range  operators  can  anticipate  new  instrumentation  requirements. 

Test  data  that  support  the  understanding  of  electro-optical  sensor  operation 
in  atmospheric  conditions  worldwide  are  required.  As  the  popxilarity  of 
electro-optical  sensor-based  weapons  spreads,  the  United  States’  forces  must 
increasingly  be  able  to  anticipate  threat  force  capability  as  a  function  of 
atmospheric  conditions.  The  recommended  methods  of  data  measurement  and 
analysis  in  these  guidelines  are  basic  tools  for  ensuring  the  production  of  reliable 
data  for  predicting  and  interpreting  worldwide  electro-optical  sensor  performance. 
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CHAPTER  1 


INTRODUCTION 


In  1983,  the  Meteorology  Group  of  the  Range  Commanders  Council  (RCC) 
recognized  the  need  to  provide  guidelines  for  electro-optical  sensor  testing  in  the 
atmosphere.  A  workshop  attended  by  experts  in  atmospheric  transmission, 
meteorology,  particulate  characterization,  and  gaseous  constituents  was  convened. 
The  experts  were  asked  to  define  state-of-the-art  measurement  methods  and 
capabilities  in  atmospheric  measurements  relevant  to  electro-optical  sensor 
testing.  The  residting  Proceedings  of  Workshop  To  Standardize  Atmospheric 
Measurements  in  Support  of  Electro-Optical  Systems,  compiled  and  edited  by  the 
University  of  Da3d;on  stedf,  formed  the  basis  for  RCC  document  356-84,  Guidelines 
for  Atmospheric  Measurements  in  Support  of  Electro-Ontical  Systems  Testing,  In 
deciding  what  atmospheric  measurements  should  be  made  in  support  of  electro- 
optical  systems  testing,  these  three  questions  should  be  addressed. 

1.  What  information  will  be  required  to  determine  the  reasons  for 
variations  in  observed  system  performance? 

2.  What  information  will  be  required  to  determine  how  the  system  or 
similar  systems  would  perform  imder  environmental  conditions  other 
than  those  during  which  the  tests  were  conducted? 

3.  What  information  is  needed  to  predict  the  performance  of  the  system 
after  deployment? 

These  requirements  have  not  changed;  although,  modem  electro-optical  sensor 
applications  require  expanded  and  more  comprehensive  measurement  approaches 
to  answer  these  questions. 

Dining  the  11  years  since  the  publication  of  document  356-84,  electro-optical 
sensor  development  and  testing  have  become  increasingly  complex  and 
demanding.  Weapons  and  surveillance  systems  increasingly  rely  on  multiple 
spectral  bands  (so  called  "sensor  fusion").  Millimeter  wave  sensors  are  pla3ing  an 
increasingly  important  role  in  multisensor  packages.  Effective  multispectral 
remote  sensing  information  interpretation  from  satellites  requires  accurate  ground 
tmth  and  reliable  surface  and  aloft  atmospheric  measurements.  Aided  target 
recognition  technology  development  and  evaluation  require  detailed  and 
sophisticated  atmospheric  measurements  and  specifications.  The  value  of 
electro-optical  weapons  and  surveillance  systems  and  atmospheric  effects  on 
performance  were  clearly  demonstrated  in  the  1991  Persian  Gulf  War  with  Iraq. 
As  a  result  of  this  and  other  successes  worldwide,  the  demand  and  development 
activity  for  these  systems  has  increased.  The  worldwide  distribution  of  these 
weapons  has  increased  demand  for  knowledge  of  effective  countermeasures  and 
methods  for  effective  operations  in  a  measure-countermeasin-e  environment. 


Available  sensor  development  and  testing  budgets  are  decreasing,  so  pressure  is 
increasing  on  test  ranges  to  acquire  atmospheric  data  not  normally  acquired  and 
with  accuracies  not  required  ten  years  ago.  All  these  factors  have  led  to  the 
blurring  of  the  borders  of  responsibility  for  particular  kinds  of  measurements  to 
support  electro-optical  sensor  test  and  evaluation. 

The  difficulty  in  supporting  electro-optical  sensor  test  and  evaluation  with 
reliable  atmospheric  measiirements  is  illustrated  in  figure  1-1.  Figure  1-1  shows 
the  Targets-Atmospheres-Sensors  Synopsis  (TASS)  that  must  be  recognized  to 
effectively  evaluate  electro-optical  sensor  performance  in  the  atmosphere.  The 
atmosphere  acts  as  a  filter  that  modifies  background  and  target  signature 
information  reaching  the  electro-optical  sensor  system.  The  target  signature 
depends  on  background  spectral  band  and  texture  (defined  by  the  sensor  xmder 
test),  spectral  contrast,  reflectivity,  range,  size,  and  orientation.  The  atmosphere 
filters  the  target  spectral  image  through  a  dynamic  lens  that  fluctuates  in  time 
and  transmittance.  The  dynamics  and  attenuation  of  the  atmosphere  impact  the 
performance  envelope  of  the  sensor  design  and  response.  Modeling,  interpreting, 
and,  in  some  cases,  measming  atmospheric  characteristics  begin  on  a  "localized 
basis"  involving  distances  typically  less  than  10  meters  and  extends  to  the 
"integrated  path  basis"  (distances  involving  htmdreds  to  thousands  of  meters 
between  the  sensor  system  and  the  target)  by  operationally  summing  localized 
basis  results.  For  example,  integrated  path  attenuation  results  fi*om  the 
summation  of  highly  variable  (in  space,  time,  and  magnitude)  localized  aerosol  and 
gas  concentrations  along  the  transmission  path.  Proper  characterization  of  the 
atmosphere  for  sensor  evaluation  requires  effective  spatial  representation  of  the 
localized  basis  with  sampling  rates  that  at  least  satisfy  the  Nyquist  criteria  which 
requires  data  be  sampled  at  a  rate  at  least  twice  as  high  as  the  highest  fi*equency 
of  the  measured  variable.  In  numerous  cases,  the  Nyquist  sampling  rate  is  too 
slow  because  the  mean  of  the  measurement  is  not  constant  during  the  sample 
averaging  duration.  Therefore,  atmospheric  testing  and  characterization  in  both  a 
localized  and  an  integrated  path  basis  are  key  elements  in  specifying  sensor 
performance.  Furthermore,  the  data  acquired  in  either  basis  must  be  accurate  to 
a  tolerance  that  depends  on  the  sensor  and  its  appHcations. 

The  need  to  accurately  measure  the  atmosphere  in  which  a  sensor  is  tested 
^d  to  make  the  proper  measurements  on  the  first  attempt,  calls  for  focused  and 
intensive  data  management  fi:om  the  identification  of  the  need  to  test  to  making 
the  data  accessible  to  the  sensor  development  and  test  and  evaluation  community. 
A  method  and  philosophy  for  achieving  intensive  data  management,  called  Total 
Quality  Data  Management  (TQDM),  is  described.  The  TQDM  forms  the  guiding 
principle  for  the  recommended  guidelines. 

The  TQDM  methods  provide  the  opportunity  for  ensuring  significant 
improvements  in  cost-effective  electro-optical  sensor  system  testing  in  the 
atmosphere.  Applying  TQDM  methods  and  standards  to  all  aspects  of 
electro-optical  sensor  system  testing  in  the  atmosphere  reduces  confusion  and 
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errors  about  sensor  operational  capability.  Sensor  development  progress  is 
measurably  enhanced,  because  the  rehable  historical  data  and  information  bases 
produced  through  TQDM  serve  as  points  of  reference  for  new  systems  and  are 
accessible  to  users.  The  TQDM  methods  and  standards  offer  a  framework  from 
which  data  quality  assurance  can  be  managed,  and  information  generated  by  all 
sources  of  data  is  made  more  accessible  to  all  qualified  users.  Quahty  data 
assurance  reduces  uncertainties  and  confusion  in  all  aspects  of  sensor-based 
weapons  development,  thus,  resources  will  be  spent  more  effectively.  Through 
TQDM  test  and  evaluation,  cost  effectiveness  increases  for  at  least  four  major 
reasons: 


(1)  resources  are  more  effectively  used, 

(2)  quantitative  standards  measure  real  progress, 

(3)  sensor  logistics  support  requirements  are  made  clear,  and 

(4)  weapons  capabiUties  are  quantified  with  known  meastu'es  of 

uncertainty. 


The  guidelines  begin  with  a  discussion  in  chapter  2,  paragraph  2.1  of  the 
approach  and  concept  of  TQDM.  The  TQDM  methods  for  identifying  and 
quantifying  qualified  data  are  described.  Information  base  development  for  a 
number  of  data  apphcation  areas  is  outlined.  Paragraph  2.2  presents  examples  of 
test  data  requirements  for  visual  image  sensor  tests,  infrared  image  sensor  tests, 
m\iltispectral  laser  range  finder  tests,  millimeter  wave  sensor  tests,  the  Smart 
Weapon  Operational  Enhancement  Program  (SWOE)  tests,  and  the  Smoke  Week 
Test  Program.  The  requirements  are  ranked  in  terms  of  importance  and  a 
nominally  required  measurement  accuracy  to  provide  an  overview  of  the 
atmospheric  measurement  requirements  for  electro-optical  sensor  evaluation. 
Paragraph  2.3  discusses  recommended  methods  for  acquiring  data  for  visual 
range,  winds,  absorbing  gases,  aerosols,  precipitation,  terrain  signatures, 
hmnidity/temperature  and  refractive  structxire  constants,  backgroimd  radiation, 
spectral  transmittance,  and  surface  and  aloft  meteorological  situations.  Next, 
paragraph  2.4  describes  a  formalism  for  determining  and  specifying  measurement 
errors.  The  formalism  includes  requirements  to  specify  root-mean-square  errors,  a 
discussion  of  the  impact  of  measurement  error  on  sensor  evaluation,  and  the 
importance  of  temporal  and  spatial  averaging  intervals.  Paragraph  2.5  discusses 
recommended  approaches  for  making  measured  data  accessible  through  archival 
data  bases  and  easily  accessible  information  bases.  Data  archival  formats  and 
storage,  information  base  generation  and  storage,  methods  of  identifying  and 
reporting  data  gaps,  and  methods  of  identifying  and  tracking  future  test 
requirements  are  described.  The  guidelines  conclude  with  appendixes  A  through 
G.  Appendix  A  is  a  set  of  tables  that  summarize  atmospheric  environmental 
parameter  requirements  needed  to  support  electro-optical  systems  testing  for 
visual  and  infrared  imager  evaluation,  laser  range  finders,  and  typical  ongoing 
Army  test  programs.  To  illustrate  the  effect  of  measurement  errors  on  data 
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applications,  appendixes  B  through  D  show  examples  of  the  impact  of  parametric 
imcertainties  on  the  probability  of  detection  for  visual  and  infrared  imaging 
systems  and  for  1.06  pm  and  10.6  pm  laser  range  finders.  Appendix  E  depicts  the 
impact  of  parametric  uncertainty  in  predicting  the  1.06  pm  and  10.6  pm  laser 
range  finder  power  on  a  designated  target.  Appendix  F  demonstrates  the  relative 
uncertainty  in  predicted  8-12  pm  transmittance  caused  by  parametric 
uncertainty  in  air  temperature,  relative  humidity,  and  visual  range.  Appendix  G 
illustrates  the  imcertainty  in  millimeter  wave  extinction  as  a  function  of  ice  and 
liquid  water  precipitation  temperatures. 
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CHAPTER  2 


MEASUREMENT  GUTOELINES 


Chapter  2  provides  g^delines  for  the  methods  of  approach,  techniques  of 
measurement,  and  methods  for  making  data  accessible  when  performing 
atmospheric  tests  to  evaluate  electro-optical  sensor  performance. 


2.1  TOTAL  QUALITY  DATA  MANAGEMENT 

Figure  2-1  is  a  schematic  that  shows  the  data  management  approach  now 
used  for  acquiring  data  in  an  electro-optical  sensor  atmospheric  test.  Data 
objectives  are  formulated  as  the  result  of  perceived  user  needs  or  to  provide  the 
opportunity  for  test  and  evaluation  in  a  characterized  environment.  Experiments 
are  designed  that  satisfy  the  data  objectives  and  take  advsmtage  of  lessons  learned 
as  the  restilt  of  data  analysis  from  past  experiments.  The  data  are  acquired  and 
archived.  After  archival,  a  minimal  effort  (relative  to  that  expended  acquiring  the 
data)  is  performed  in  data  evaluation  on  a  few  selected  data  sets.  The  archived 
data,  whether  qualified  or  not,  are  made  available  to  data  users  for  atmospheric 
characterization,  model  "validation"  (more  properly  called  evaluation),  sensor 
design  or  capability  specification,  and  military  applications  particularly  as  the 
data  apply  to  operations  involving  weapons  systems  using  electro-optical  sensors. 
The  data  may  also  provide  a  point  of  reference  for  defining  future  experiments. 

The  data  generated  in  atmospheric  electro-optical  sensor  tests  and 
experiments  are  voliuninous.  Even  after  they  are  ardiived,  they  may  still  be 
practically  inaccessible.  The  user,  with  a  few  notable  exceptions,  has  neither  the 
interest,  training,  time,  or  funds  to  manipulate  large  quantities  of  data  to  extract 
the  information  needed.  It  is  often  perceived  as  easier  to  do  an  additional 
specialized  test  or  experiment  than  to  work  with  the  existing  data  base. 
Consequently,  improving  the  cost  effectiveness  of  test  data,  providing  ready  access 
to  the  data  base,  and  developing  methods  for  generating  relevant  information  from 
the  data  are  as  important  as  the  original  data  production. 

Study  of  the  process  illustrated  by  figure  2-1  shows  that  each  major  block  in 
the  data  production  and  use  process  has  an  impact  on  the  blocks  preceding  it.  In 
fact,  the  process  being  addressed  is  a  data  cycle,  as  seen  in  figure  2-2a,  rather 
than  as  figure  2-1  presents,  a  linear  data  path.  The  data  cycle  exists  because  past 
test  results  and  experience  affect  how  future  tests  are  conducted  and  affect  the 
development  of  future  models  and  imderstanding  of  atmospheric  impacts  on  future 
sensor  performance.  Significant  improvements  in  atmospheric  data  quahty  and 
reduction  of  expected  problems  in  data  applications  require  recognition  of,  and 
improvement  in,  all  phases  of  this  data  cycle. 


Figure  2-1.  Data  management  approach  now  used  for  acquiring  data  in  an  electro-optical  sensor 
atmospheric  test. 


An  approach  to  the  recognition  and  improvement  of  the  data  cycle  is 
illustrated  in  figures  2-2  a-f.  The  approach  and  improvement  methods  depicted  in 
figures  2-2  a-f  are  called  Total  Quality  Data  Management  (TQDM).  Comparison  of 
figures  2-1  and  2-2  a-f  shows  that  TQDM  improves  or  enhances  all  aspects  of  the 
current  data  path. 

Figure  2-2b  shows  that  in  tlie  TQDM  approach,  data  objectives  are  produced 
by  users  who  either  have  used  information  bases  representing  data  applications 
and  costs/benefits  analysis  to  determine  test  requirements,  or  because  of  new 
r(  quirements  input,  data  objectives  are  generated  independently  of  the  existing 
information  base.  When  data  objectives  are  defined  on  the  basis  of  past  test 
experience,  the  data  applications  information  bases  are  used  to  develop  required 
measurement  standards.  These  standards  define  the  minimxun  accuracy 
requirements  and  capabilities  needed  to  acquire  data  satisfying  new  data 
objectives. 

As  in  the  existing  data  path  approach  (figure  2-1),  the  data  objectives  are 
used  to  develop  the  experimental  design.  However,  as  noted  in  figure  2-2c,  the 
TQDM  approach  experimental  design  is  driven  by  instrument  calibration 
requirements  and  built-in  methods  of  measurement  cross-checks.  These  factors 
are  parametric  data  quality  foimdations.  Figure  2-2d  demonstrates  that  these 
factors  form  the  basis  for  on-line  data  checks  as  the  data  are  acquired.  During 
data  acquisition,  the  results  are  compared  with  experiment  expectations  which  are 
based  on  the  historical  data  and  models  residing  in  the  information  bases.  These 
data  checks  quickly  identify  any  unexpected  measurement  errors  or  new  results. 
These  results  provide  the  stimulus  to  repeat  or  to  obtain  additional  comprehensive 
data  during  the  test.  Thus,  repeated  meascirements  can  eliminate  data  artifacts 
or  reinforce  imexpected  results.  Supporting  data  also  are  tested  as  they  are 
acquired  and  are  viewed  as  necessary  caveats  of  the  primary  data. 

After  data  acquisition  is  complete,  figure  2-2e  illustrates  that  detailed  data 
evaluation  begins  in  order  to  qualify  the  data.  The  data  are  specified  as  to 
application  in  particular  information  bases.  A  relative  quality  level  for  the  data 
(for  example,  when  only  baseline  data  or  data  with  high  uncertainties  are 
available)  is  assigned.  The  data  evaluation  qualifies  the  data  for  a  measurement 
error  range.  Evaluation  is  achieved  by  identifying  likely  errors  and  error  sources, 
testing  for  consistent  results  between  independent  measiirements  (planned 
measmement  cross-checks),  and  comparing  new  data  with  historical  data. 

After  data  evaluation,  the  data  are  archived  in  formats  that  permit  the 
qualification  and  specification  of  the  data.  The  data  are  then  available  for  Data 
Applications.  The  Data  Applications,  for  which  five  examples  are  shown  in  figure 
2-2f,  are  also  used  to  generate  information  bases.  The  information  bases  provide 
inputs  to  future  data  objectives  and  provide  points  of  reference  and  information  for 
costs/benefits  analyses.  Such  analyses  aid  planners  in  decisions  affecting  the 
development  of  new  sensor  or  weapons  systems  that  produce  new  data  objectives. 
And  the  cycle  begins  again. 
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TOTAL  QUALITY  DATA  MANAGEMENT 


TEST-REQUIREMENTS 


TEST-REQUIREMENTS 


Figure  2-2c.  TQDM  requires  that  experimental  designs  include  requirements  and  standards  for  instrument 
calibrations  and  methods  to  obtain  cross-check  measurements. 


TEST-REQUIREMENT 
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Figure  2-2d.  Data  acquisition  under  TQDM  requires  on-line  data  checks  to  identify  extraordinary  or  potentially 
problematic  data  and  methods  of  comparing  data  with  expectations  and  quality-assuring 
supporting  data. 


CO 

o 

q: 

< 


^9 


CO 


o 

H 

< 

o 


a. 

Q. 


< 

a 


g 

H 

u 

3 

Q 

O 

a: 

CL 

< 

o 


h- 


LU 


< 

H 

< 

G 

< 

D 

a 

< 

H 

o 

H 


g 

H 

< 

D 

-J 

< 

> 

LU 

< 

I- 

< 

Q 


2-8 


Figure  2-2e.  Data  evaluation  under  TQDM  requires  the  data  be  qualified  and  specified  as  to  errors  and  accuracy 
through  application  of  instrumentation  error  functions,  identification  of  errors  and  error 
soimces,  tests  for  data  consistency,  and  by  comparison  with  previously  acquired  data. 


TESI^ReQUIREMENTS 
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Figure  2-2f.  The  Total  Quality  Data  Management  data  cycle. 


Figure  2-3  illustrates  the  information  base  concept.  Information  bases  use 
data  base  structures  and  formats  to  store  and  make  accessible  the  results 
generated  using  archived  data  produced  during  a  sensor  test.  Data  application 
results  (for  example,  model  predictions  of  sensor  performance  compared  with 
actual  measured  performance)  are  organized  and  summarized  in  the  information 
base.  In  this  manner,  the  information  user  does  not  have  to  deal  with  large 
quantities  of  data  to  find  the  information  of  interest.  Information  bases  provide  a 
key  element,  information  access,  in  the  data  cycle.  They  include  an  information 
evaluation  system  that  provides  methods  of  costs/benefits  analysis.  The 
costs/benefits  analysis  is  used  to  test  and  place  in  perspective  the  value  or  cost  of 
developing  new  sensors  or  information. 

Successftd  qualification  of  the  data  classes  and  development  of  atmospheric 
characterization  information  requires  a  clear  imderstanding  of  the  Targets- 
Atmospheres-Sensors  Synopsis  (TASS)  shown  in  figure  1-1.  The  TASS 
relationships  reveals 

•  atmospheres  have  spectral  electromagnetic  wave  propagation  and 
emission  characteristics  that  depend  on  particular  boundary  conditions 
such  as  location,  time  of  year,  and  synoptic  meteorology; 

•  targets  have  spectrally  emissive  or  reflective  electro-magnetic  signatures; 

•  terget  backgrounds  have  spectral  reflection,  emission,  and  clutter 
characteristics  that  define  target  spectral  contrast  that  meteorology 
directly  affects  through  precipitation,  temperature,  radiation  loading,  and 
wind/evaporation  drying  and  cooling;  and 

•  the  operating  characteristics  of  electromagnetic  wave  sensors  are 
sensitive  to  these  factors. 

All  of  the  TASS  parameters  must  be  considered  in  evaluating  electro-optical 
sensor  performance  in  the  atmosphere. 

Data  bases  providing  data  for  evaluating  and  developing  models  and 
simulations  of  electro-optical  sensor  performance  must  present  information  on  all 
aspects  of  the  TASS  parameters.  As  a  result,  TASS  will  be  used  as  a  general  term 
throughout  this  report  for  TASS-related  data  and  data  bases.  The  TASS  data  can 
be  classed  into  four  groups:  atmospheric  optical  and  meteorological  data,  aerosol 
obscurants  characteristics  data,  target  and  backgroimd  signatvue  data,  and  sensor 
characteristics  data. 
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Figure  2-3.  The  information  base  concept. 


The  data  groups  can  be  related  through  mathematical  models. 
Measurements  for  a  particular  data  group  are  affected  by  parameters  in  the  other 
groups.  The  data  analyst  must  be  aware  of  this  fact  to  separate  data  artifacts 
from  reliable  data  and  to  identify  and  explain  anomalous  performance.  To 
understand  atmospheric  effects  on  TASS  linkages,  measured  data  can  be  grouped 
into  that  obtained  over  integrated  path  basis  scales  (data  involving  distances 
greater  than  about  100  meters)  or  localized  basis  scales  (data  involving  distances 
about  10  meters  or  less).  The  TASS  linkages  occur  because  the  integrated  path 
basis  effects  on  electromagnetic  wave  propagation  can  be  predicted  through 
summations,  averages,  and  correlation  of  localized  basis  values.  Prediction  of 
integrated  path  basis  values  from  localized  basis  values  is  one  method  of  testing 
mathematical  models  and  experimental  data.  Integrated  path  basis  data  include 
multispectral  transmittance,  radiometric  data  from  obscurants  or  targets, 
refractive  or  humidity  scintillation  effects,  and  line-of-sight  crosswind 
distributions.  Localized  basis  data  include  aerosol  particle  size  distributions,  mass 
extinction  coefficients,  temperature,  and  humidity  ttirbulence  characteristics. 


2.1.1  TQDM  Methods  for  Identifying  and  Quantifying  Qualified  Data.  In 
this  subparagraph,  brief  examples  of  methods  for  identifying  and  quantifying 
qualified  data  are  discussed.  A  detailed  discussion  of  data  quality  control  methods 
applicable  to  many  measurements  associated  with  testing  electro-optical  sensors  in 
the  atmosphere  and  supplements  methods  are  given  in  RCC  document  382-94,  A 
Guide  For  Quality  Control  of  Surface  Meteorological  Data.  1994,  by  C.  Biltoft  et  al. 
The  suggested  methods  in  these  gmdelines  are  not  new;  however,  their  application 
to  atmospheric  measurement  instruments  for  electro-optical  sensor  testing  in  the 
atmosphere  is  not  routinely  performed.  Several  side  benefits  are  expected  from 
the  development  and  application  of  these  methods.  These  benefits  are  listed 
below. 

•  Standardized  methods  are  used  to  ensure  qualified  data.  These  methods 
can  be  used  on  existing  data  and  in  the  acquisition  of  future  data. 

•  Instrumentation  error  functions  for  data  qualification  are  applied  to 
instruments  now  in  use.  These  functions  allow  data  producers  to  report 
their  data  acquired  with  proper  error  bar  representations. 

•  The  degree  to  which  various  measurement  methods  should  agree  is 
quantified. 

•  Data  qualification  methods  provide  proper  choices  of  instrument 
ensembles  for  experiments  to  test  mathematical  models  with  required 
levels  of  measxxrement  acciiracy. 

•  Levels  of  model  and  sensor  simulation  performance  are  independently 
established.  The  establishment  of  model  and  sensor  simulation 
performance  provides  a  baseline  against  which  the  performance  of  future 
models,  simvdations,  and  tactical  decision  aids  can  be  estabUshed. 
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Methods  for  developing  qualified  data  are  outlined  next. 

Atmospheric  effects  on  electro-optical  sensor  performance  data  often  are  not 
specified  with  error  bars.  A  major  reason  for  this  limitation  is  that  instrument 
response  functions  have  not  been  developed  to  produce  an  estimate  of  instrument 
measurement  imcertainty  as  a  function  of  response.  By  developing  and  applying 
these  functions,  minimum  levels  of  uncertainty  are  specified  for  the  data,  and 
maximum  accuracy  values  are  established.  Only  those  data  within  an  acceptable 
level  of  imcertainty  are  included  in  a  qualified  data  ensemble. 

Data  error  function  evaluation  gives  only  maximmn  imcertainty  levels  for 
random  errors.  As  a  result,  it  is  necessary  to  establish  additional  tests  for  the 
data  to  detect  systematic  errors  and  anomalous  behavior.  An  example  of  these 
types  of  tests  is  the  optical  depth  regression  analysis  using  miiltispectral 
transmission  data.  At  least  three  major  tests  for  internal  consistency  and 
accuracy  can  be  applied  to  transmission  data  using  this  approach.  First,  the  data 
are  tested  for  acceptable  noise  and  minimum  acceptable  transmission  levels. 
Second,  broad  band  data  are  tested  against  narrow  band  data  within  the  broad 
band  (for  example,  determine  if  90-  to  95-Ghz  transmission  is  consistent  with  92.5 
Ghz  transmission).  Third,  the  data  are  tested  to  determine  if  the  Beer-Bouguer 
transmission  law  should  include  band  averaging  or  multiple  scatter  effects.  These 
tests  can  be  performed  through  regression  analysis  of  the  logarithmic  transmit- 
tances  (optical  depths)  for  any  pair  of  spectral  band  transmittances  along  a 
common  line  of  sight  (ref  1,  2). 

A  useful  method  of  identifying  questionable  data  is  to  compare  estimates  of 
the  same  parameter  using  independent  measiu’ements.  Farmer  has  discussed  this 
method  in  detail  for  a  variety  of  aerosol  measuring  instruments  (ref  1).  By 
computing  the  same  parameter  with  data  obtained  by  independent  methods,  data 
consistency  is  tested;  data  that  are  inconsistent  can  be  flagged  for  detailed 
analysis  and  review.  Results  of  the  analysis  may  even  call  for  additional 
experiments  to  determine  the  sources  of  the  differences  between  the  two  data  sets. 
It  is  often  possible  to  examine  integrated  path  basis  (localized  basis)  data  for 
theoretical  integrated  path  basis  (localized  basis)  predictions  to  ensure  the  data 
are  consistent.  In  those  cases  where  strong  and  consistent  disagreements  exist 
between  theory  and  experiment,  the  assumptions  used  to  develop  the  theory  or 
data  must  be  reexamined  and  closely  reviewed. 

When  possible,  field  measurements  data  should  be  compared  with 
laboratory  data.  Laboratory  data  typically  yield  reasonable  parametric  values  for 
comparison  with  data  computed  using  field  measm*ements,  and  it  is  especially 
true  when  field  data  are  obtained  under  stable  atmospheric  conditions.  When 
large  consistent  differences  in  the  data  sets  are  found,  a  determination  should  be 
made  of  why  the  data  disagree.  For  example,  suppose  the  field  data  are 
reasonable  and  reproducible  under  a  variety  of  test  conditions  but  disagree  with 
laboratory  data.  Neither  data  set  is  considered  incorrect.  However,  a  careful 
examination  of  the  differences  in  the  measurement  protocols  is  necessary  to 
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ensure  operational  errors  are  not  made.  Standardized  protocols,  for  example,  for 
the  measurement  of  obscurants  in  laboratory  and  field  environments  have  evolved 
fi*om  such  efforts. 

Data  that  can  be  verified  as  to  accuracy  and  relative  error  by  the  methods 
outlined  earlier  are  maintained  separately  fi’om  data  that  cannot  be  verified  but 
should  not  be  thrown  away.  Unverified  data  should  be  categorized  carefully 
noting  the  reasons  they  were  not  evaluated  for  an  accuracy  estimate.  They  can  be 
used  to  help  identify  potentially  erroneous  data  by  comparing  it  to  the  data  that 
have  been  characterized  as  being  erroneous.  An  explanation  of  the  error  sources 
should  be  added.  The  quality  of  data  obtained  in  field  experiments  is  improved 
steadily  in  this  way. 

A  standardized  data  set  is  a  natxmal  result  of  the  data  qualification  process. 
These  data  sets  are  used  to  test  mathematical  models  and  to  provide  descriptions 
of  standard  sensor  performance.  Standardized  data  sets  are  generated  by  forming 
statistical  distributions  of  data  parameters  for  a  broad  range  of  qualified  data. 

The  choice  of  parameters  with  which  to  group  data  is  largely  arbitrary; 
nevertheless,  after  an  acceptable  parametric  division  of  data  is  developed, 
statistical  functions  are  generated  to  represent  the  individual  field  or  laboratory 
experiments  producing  qualified  data.  Individual  data  distributions  are  added  to 
produce  a  master  distribution  for  the  parametric  set  of  interest.  Standard 
deviations  and  mean  values  are  computed  for  the  data  increments  used  in  the 
master  distribution.  The  master  distributions  include  both  accumxilative 
probabilities  and  probability  densities.  This  approach  to  the  generation  of 
standardized  data  sets  has  these  advantages: 

•  all  data  that  are  considered  consistent  and  reliable  are  used; 

•  data  fi“om  different  instruments  for  the  same  tests  are  grouped; 

•  areas  where  data  are  scarce,  and  where  additional  experiments  need  to 
be  conducted,  are  identified; 

•  the  range  of  data  variance  (through  the  generation  of  mean  and  standard 
deviation  values  for  each  data  increment)  is  quantified  and  the  statistical 
stability  of  the  data  is  ensured;  and 

•  personal  biases  of  model  and  simidation  developers  in  choosing  and  using 
data  for  model/simulation  evaluation  are  removed. 


2.1.2  DevelopmfiTit  Of  Information  Bases.  A  clear  perspective  is  needed  of 
how  a  data  base,  once  measured  and  used  for  its  initially  intended  purpose,  ran  be 
used  in  other  appUcations.  It  is  suggested  that  a  proper  perspective  for  the  long 
term  use  data  developed  imder  this  and  other  efforts  relevant  to  atmospheric 
testing  of  electro-optical  sensors  is  the  development  of  reference  and  information 
bases  derived  firom  archival  data  bases.  The  need  of  many  potential  data  users  is 
not  for  data  but  for  information  derived  fi'om  data.  The  electro-optical  sensor 
system  designer  cares  little  about  the  sensor  line-of-sight  transmission  history 
during  a  field  trial.  For  example,  data  important  to  the  designer  are  the  length  of 
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time  the  sensor  spectral  band  atmospheric  transmission  is  below  the  system 
operational  threshold.  There  is  interest  in  the  probability  that  a  transmission 
threshold  level  will  exist  for  a  given  set  of  atmospheric  conditions.  Model 
developers  require  standardized  data  sets  and  standardized  evaluation  methods 
for  testing  models.  Data  producers  need  ready  reference  to  instrumentation  error 
functions  that  can  be  used  with  their  instruments.  Operations  analysts  need 
ready  reference  to  realistic  performance  of  various  electro-optical  sensor  systems 
in  a  broad  range  of  atmospheric  environments. 

In  this  part,  several  of  the  more  important  information  bases  are  discussed 
that  can  be  generated  from  electro-optical  sensor  system  atmospheric  measure¬ 
ment  data  bases.  The  list  is  not  exhaustive.  It  illustrates  the  types  of  information 
that  will  be  immediately  useful. 


2.1.2.1  Tfistrumentation  Error  Functions.  Error  functions  for  electro-optical 
sensor  system  atmospheric  test  instrumentation  form  a  highly  useful  information 
base.  Making  commonly  used  error  functions  available  in  an  information  base 
allows  data  producers  to  report  data  with  error  bars  as  the  data  are  produced,  to 
reduce  post-test  analysis  time,  and  to  provide  a  common  data  evaluation  protocol 
for  a  variety  of  instrumentation  operations.  Error  functions  also  show  which 
operational  parameters  of  the  measurement  instrument  give  the  greatest  errors. 
This  information  provides  the  instrument  operator  with  guidance  in  identifying 
important  error  sources  when  data  are  taken.  In  some  cases,  electro-optical 
sensor  system  designers  can  use  this  information  to  improve  system  response. 
The  range  of  measured  data  applicable  to  mathematical  model  validation  is  clear 
using  these  functions. 


2.1.2.2  Standardized  Methods  of  Data  QualificatioiL  Development  of  data 
qualification  methods  provides  a  standard  for  the  quality  of  all  acquired  data  in 
electro-optical  sensor  systems  atmospheric  testing.  Such  methods  can  be  made 
available  through  an  information  base.  Standardized  data  qualification  methods 
provide  field  test  support  customers  with  the  ability  to  set  standards  for 
acceptable  data,  and  to  understand  data  accuracy  limitations.  These  standards 
cem  form  the  basis  for  research  and  development  programs  using  qualified  data  for 
analysis,  system  evaluation,  and  model  and  simulation  development. 


2.1^.3  Standardized  Data  Sets  from  Statistical  Summaries  of  Qualified 
Data.  Quantitative  and  qualitative  standardized  data  set  information  bases  are 
described  in  the  following  subparagraphs. 


2.1.2.3.1  Quantitative  Data.  Statistical  summaries  of  existing  data  can  be 
generated  and  located  in  an  information  base  to  provide  a  standardized  set  of 
quantitative  reference  data.  To  achieve  this  goal,  test  data  first  are  grouped  into 
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statistical  sxumnaries  using  qualified  data.  The  data  are  sorted  according  to 
meteorological  conditions  and  electro-optical  sensor  type  evaluated  during  the  test. 
Then,  for  example,  data  for  a  particular  type  of  measurement  are  grouped  to  form 
a  probability  density  function.  The  density  function  is  interpreted  as  the 
probability  that  a  particular  value  or  range  of  values  will  exist  for  a  particular  set 
of  test  conditions.  (Trial-to-trial  and  test-to-test  variances  will  be  smoothed  and 
properly  averaged  in  this  way.) 

Statistical  data  summaries  located  in  an  information  base  are  viewed  as  the 
most  reliable  set  of  data  available.  In  addition  to  the  data  probability  distribution 
functions,  analytical  functions  determined  by  curve  fitting  the  data  can  be 
developed  and  included  as  well.  Thus,  simple  numeric  measures  (for  example, 
moments  of  the  distributions)  can  be  used  to  characterize  the  data.  These  data 
will  provide  direct  comparisons  of  parametric  changes  in  electro-optical  sensor 
performance  for  various  test  conditions. 


2.1.2.3.2  Qualitative  Data.  Usually,  qualitative  data  consists  of  human 
observer  responses  to  targets  viewed  directly  with  the  eye  or  with  some  type  of 
imaging  system.  Multispectral  imaging  systems  include  visual  (0.4-0, 7  pm),  near 
infrared  (0.7- 1.1  pm),  mid  infrared  (3-5  pm),  and  far  infrared  (8-14  pm)  types. 
Additionally,  millimeter  wave  sensors  (for  example,  systems  that  employ 
synthetic-aperture  radar  (SAR)  or  side-looking  radar  (SLR)  systems)  that  require 
user  interpretation  are  under  development.  Millimeter  wave  (MMW)  imaging 
systems  are  not  common  but  will  be  a  major  development  item  in  the  next  few 
years.  Information  bases  for  observer/user  response  data  are  as  valuable  as  the 
responses  from  hardware  based  sensor  systems.  Human  responses  to  imager 
outputs  are  basic  factors  that  help  define  sensor  performance  in  the  atmosphere. 
Statistical  summaries  of  human  responses  to  targets  imaged  through  the 
atmosphere  should  be  included  in  an  information  base.  With  these  data, 
correlations  are  determined  between  quantitative  atmospheric  data  and  human 
responses  to  observed  targets. 


2. 1^.4  Model  Performance  for  Standardized  Data  Sets.  Many 
electro-optical  sensor  atmospheric  performance  models  now  exist.  Electro-optical 
sensor  system  developers  and  others  who  rely  on  these  models  must  have  a  clear 
imderstanding  of  their  predictive  strengths  and  weaknesses.  Information  bases 
that  record  the  resxilts  of  model  predictions  for  the  standardized  data  sets 
described  in  subparagraph  2.I.2.3.  contribute  to  total  data  base  dissemination. 
Comparison  methods  for  quantifying  model  performance  also  are  established  and 
located  in  the  information  base.  These  procedures  develop  standards  against 
which  future  models  are  tested  and  provide  a  standard  basis  for  model 
performance  improvement. 
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2.1^.5  Electro-Qptical  System  Performance  Relative  to  Atmospheric 
Characteristics.  In  this  section,  examples  of  information  bases  needed  to 
characterize  electro-optical  system  performance  relative  to  atmospheric 
characteristics  are  considered. 


2.1.2.5.1  Electro-Optical  Sensor  System  Target  Signatures.  Electro-optical 
sensor  system  effectiveness  depends  on  the  target-background  spectral  contrast 
and  angular  subtense  of  the  target  to  the  sensor.  Consequently,  an  information 
base  of  target-background  spectral  signatures  assists  in  evaluating  atmospheric 
impacts  on  electro-optical  sensor  systems.  These  data  should  represent  targets 
such  as  armored  fighting  vehicles,  airplanes,  ships,  and  buildings  for  a  wide  range 
of  atmospheric  conditions  and  target/background  clutter  signatures. 


2.1.2.5.2  Electro-Optical  Sensor  System  Target  Acquisition  Envelopes. 

Electro-optical  sensor  system  developers  must  define  the  conditions  under  which  a 
sensor  can  acquire  a  target  in  atmospheres  with  and  without  aerosol  counter¬ 
measures  or  severe  aerosol  backgrounds  such  as  low  visibility  hazes.  Although 
target  acquisition  models  are  now  somewhat  limited,  comprehensive  TASS 
information  bases  help  to  define  "target  acquisition  envelopes."  Target  acquisition 
envelopes  form  an  effective  information  base  which  can  serve  a  variety  of  purposes 
such  as  definition  of  data  that  are  lacking  to  confirm  the  system  performance 
envelope,  comparison  of  different  system  performances  under  a  variety  of 
atmospheric  conditions,  and  provision  of  information  for  the  development  of 
tactical  decision  aids  and  other  models. 


2.1.2.5.3  Normalized  Electro-Optical  Sensor  Response  Funetions.  One  of 
the  major  sources  of  disagreement  between  data  from  the  same  types  of  electro- 
optical  systems  is  that  systems  operating  in  the  same  band  cein  have  radically 
different  spectral  responses.  As  an  illustration,  transmissometer  measurements 
for  the  same  atmospheric  optical  depth  from  two  systems  operating  in  the  same 
spectral  band,  but  with  different  spectral  responses,  can  produce  different  values  if 
the  atmosphere  has  a  significant  spectral  extinction  structure  over  the  spectral 
band.  To  interpret  spectrally  dependent  data,  electro-optical  sensor  spectral 
response  data  must  be  available. 

Applications  of  electro-optical  sensor  response  functions  range  firom  the 
tactical  evaluation  of  systems  to  the  evaluation  of  sensor  response  to  a  particular 
environment  with  mathematical  models.  These  data  include  both  system  and 
detector  spectral  response  data  for  weapons  systems  and  for  instrumentation 
systems  such  as  transmissometers. 
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2.1.2.5.4  Electro-Optical  Sensor  System  Classification  Methods.  An 
information  base  established  to  contain  the  methods  for  classifying  electro-optical 
sensor  system  response  to  the  atmosphere  is  useful.  This  information  base  has  at 
least  four  functions:  (1)  classification  of  operational  characteristics  of  electro- 
optical  sensor  systems  by  their  response  to  atmospheric  characteristics, 

(2)  identification  of  specific  atmospheric  data  needed  to  support  evaluation  of 
electro-optical  system  operational  characteristics,  (3)  identification  of  algorithms 
and  models  that  are  used  to  evaluate  electro-optical  sensor  system  performance 
using  standardized  data  sets,  and  (4)  identification  of  models  predicting 
probability  of  occurrence  and  the  expected  range  of  variables  for  a  given 
operational  or  test  scenario,  and  of  meteorological  conditions. 


2.2  TEST  DATA  REQUIREMENTS 

Testing  electro-optical  sensor  systems  in  the  atmosphere  is  driven  by  three 
basic  information  requirements.  These  requirements  are  determining  reasons  for 
variations  in  observed  system  performance,  how  the  system  will  perform  imder 
environmental  conditions  other  than  those  of  test  conations,  and  how  the  system 
will  perform  after  it  is  deployed.  The  first  information  requirement  is  needed  in 
case  the  sensor  should  fail  to  perform  as  anticipated,  and  an  explanation  is 
required  for  the  cause  of  failure.  The  second  information  requirement  originates 
because  electro-optical  sensor  systems  operate  under  a  wide  variety  of  test 
conditions  not  included  in  the  tests.  The  third  requirement  arises  because 
deployment  is  the  ultimate  purpose  of  a  development  program.  Atmospheric  tests 
are  calibration  points  and  reality  checks  for  defining  sensor  system  performance 
under  near-realistic  operating  conditions.  Before  deployment,  a  sensor  cannot 
possibly  be  tested  imder  every  operational  condition  for  which  it  was  intended. 
Accordingly,  test  results  also  provide  an  experimental  measure  of  the  capabihty  of 
mathematical  models  to  predict  sensor  performance  under  the  full  operational 
envelope  of  environment^  conditions.  If  the  model  predictions  are  within 
acceptable  error  limits,  it  is  assumed  that  the  model  contains  a  reasonable 
representation  of  how  the  sensor  vdll  perform  under  conditions  that  were  not 
tested. 

It  is  important  for  test  operations  to  quantify  atmospheric  measurement 
errors  as  well  as  system  performance.  Measurement  uncertainty  is  as  equally 
important  as  the  mean  value  of  the  measurement.  Definition  of  measurement 
uncertainty  ensures  that  models  used  to  predict  sensor  performance  have  inputs 
that  can  specify  the  imcertainty  in  sensor  performance  under  all  intended 
environmental  conditions  and  deployment  scenarios  for  which  it  was  intended. 
This  section  provides  examples  of  electro-optical  sensors  tested  in  the  atmosphere. 
Also  presented  are  examples  of  measurement  requirements  for  models  likely  to  be 
used  for  predicting  sensor  performance  in  environments  other  than  the  test 
conditions  or  for  deployment  scenarios. 
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Examples  of  electro-optical  sensor  test  applications  requiring  atmospheric 
data  are  (1)  visual  sensor  target  detection;  (2)  infrared  sensor  target  detection; 

(3)  laser  range  finder  ranging  for  1.06,  1.54,  and  10.6  pm  wavelengths; 

(4)  millimeter  wave  sensor  transmission;  (5)  the  tri-service  Smart  Weapons 
Operation  Enhancement  (SWOE)  measurement  program;  (6)  the  U.S.  Army 
Research  Laboratory  Smoke  Week  test  program;  and  (7)  littoral  warfare  testing. 
The  first  four  applications  are  for  specific  broad  and  narrow  bcmd  sensor  types. 

The  fifth  and  sixth  apphcations  are  for  ongoing  programs  that  acquire  data  for 
supporting  a  variety  of  broad  and  narrow  band  sensors,  and  the  seventh 
apphcation  is  for  unique  test  requirements  at  the  land  and  sea  interface. 

Table  2-1  provides  a  list  of  variables  recommended  for  measurement  to 
support  examples  of  the  above  sensor  types  and  for  applications  and  measxire- 
ments  hkely  to  be  reqioired  for  ongoing  programs.  When  a  parameter  is  used 
directly  in  the  evaluation  of  a  particular  application  or  measurement,  an  x  appears 
in  the  table.  The  applications  include:  (1)  visual  probability  of  detection  (VISUAL 
PD);  (2)  infrared  broad  band  transmission  (IR  BRDBND  TRANS);  (3)  infrared 
narrow  band  transmission  (IR  NARROW  BND  TRANS);  (4)  infrared  imager 
probability  of  detection  (ER  IMAGER  PD);  (5)  visual  or  infrared  precipitation 
transmission  (VISUAL/IR  PRECIP  TRANS);  (6)  millimeter  wave  precipitation 
transmission  (MMW  PRECIP  TRANS);  (7)  millimeter  wave  transmission  (MMW 
TRAN);  (8)  laser  range  finder  probability  of  detection  (LRF  PD);  (9)  counter¬ 
measure  aerosol  transport  and  diffusion  (CM  TRNSPRT  AND  DIFF);  and 
(10)  ultraviolet  trzuismission  (UV  TRANS). 

In  table  2-1,  40  parameters  are  listed.  The  parameters  are  organized  by 
blocks  of  related  variables  which  are  separated  by  a  heavy  line.  The  following 
discussion  indicates  how  the  parameters  are  used  in  evaluating  electro-optical 
sensor  performance.  Path  luminance  is  a  major  contributing  factor  to  visual 
target  contrast  reduction.  Parameters  1  and  2  define  the  position  of  the  stm  and 
are  used  to  locate  the  position  of  the  brightest  and  most  direct  contributor  of 
radiation  to  path  illiunination,  target  illumination,  and  sensor  threshold 
sensitivity.  Parameters  3-9  are  used  to  show  the  directional  contrast  and 
transmittance  state  of  the  atmosphere  at  ground  level  and  for  slant  ranges. 
Parameters  10-12  assist  in  ascertaining  atmospheric  transport  and  diffusion  of 
atmospheric  aerosols,  particularly  those  aerosols  used  as  passive  coimtermeasures 
against  electro-optical  sensors.  Parameter  13  is  not  appHcable  to  visual  sensor 
evaluations  but  is  significant  for  infrared  imaging  systems.  Aerosol  parameters 
14-16  play  a  fundamental  role  in  describing  sensor  performance  in  the 
atmosphere,  because  light  scattered  from  aerosols  reduces  target  contrast  and 
attenuates  signal  level.  Visual  contrast  reduction  effects  can  be  more  significant 
in  reducing  visual  probability  of  detection  than  image  attenuation.  Precipitation 
characterization  established  by  parameters  17-19  is  required  to  compute  visual 
range  or  millimeter  wave  (MMW)  transmission.  Parameters  20  and  21  aid  in 
defining  backgroimd  feature  contrasts.  Dew/frost  are  feature  signatures  that 
strongly  affect  target-to-backgroxmd  spectral  contrast.  Spectral  emissivity  is  used 
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TABLE  2-1.  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  ELECTRO-OPTICAL  SYSTEMS  TESTING 
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21  Target/background  emissivity 

22  Relative  Humidity  Structure  Const. 

23  State  of  surface 

24  Sea  state 


TABLE  2*1  (Confd).  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  ELECTRO-OPTICAL  SYSTEMS  TESTING 
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with  thermodynamic  temperature  measurements  of  target  and  background  to 
estimate  target  thermal  contrast.  Target/backgroimd  emissivity  is  of  primary 
interest  only  for  infrared  sensor  systems.  Parameter  22,  the  relative  humidity 
structure  function,  is  of  primary  interest  for  MMW  transmission  because  it  is  used 
to  determine  temporal  fluctuations  and  scintillation  in  the  transmitted  beam. 
Parameters  23  and  24  define  the  sea  state  environment.  Parameters  25-31 
characterize  the  illumination  environment  in  which  the  sensor  is  tested.  For 
visual  sensors,  the  illumination  environment  is  particularly  important.  Spectral 
transmittance,  parameter  32,  is  key  to  determining  many  of  the  atmospheric 
characteristics  that  limit  any  sensor’s  performance.  The  index  of  refraction 
structure  constant,  parameter  33,  is  used  to  describe  the  limiting  resolution  of  the 
imaging  sensor  and  image  scintillation  or  fluctuation  frequency.  This  variable  is 
one  of  the  most  important  for  ultraviolet,  visual,  and  near-infrared  band  sensor 
evaluation.  Parameters  34-40  are  required  for  atmospheric  definition  in  all 
spectral  bands. 

The  parameters  listed  in  table  2-1  have  been  used  to  develop  the  tables  in 
appendix  A.  The  format  of  the  tables  is  the  same  for  all  the  examples  of 
electro-optical  sensor  evaluations  discussed  in  this  guideline.  Each  table  shows 
recommended  dimensional  units,  provides  the  rationale  for  measuring  the 
variables,  suggests  the  averaging  period  for  the  measured  parameter,  defines  the 
parameter’s  relative  importance  on  a  scale  of  1-4  with  1  being  the  most  important, 
and  suggests  a  nominal  acceptable  error.  Paragraph  2.3  and  its  subparagraphs 
describe  recommended  measurement  methods  for  the  most  significant  variables 
listed  in  table  2-1.  The  subject  of  acceptable  measurement  error  is  discussed  in 
detail  in  paragraph  2.4  where  it  is  shown  that  acceptable  measurement  error 
vanes  strongly  with  specific  test  requirements. 

In  the  sections  that  follow,  discussions  are  provided  of  how  the 
measurements  are  applied  to  the  example  system  test  requirements.  The 
discussion  is  intended  to  provide  the  reader  with  an  imderstanding  of  the 
differences  encountered  in  tests  of  different  sensors  and  of  the  need  to  ensure 
comprehensive  and  detailed  data  management  as  determined  by  a  TQDM 
approach. 


2.2.1  Visual  Sensor  Tests.  Visual  sensors  respond  to  target- to-backgroimd 
contrast  (ref  5,  6).  Visual  sensor  tests  are  among  the  more  difiicult  to  perform, 
because  so  many  related  atmospheric  factors  affect  object  contrast  and,  therefore, 
sensor  performance.  Key  factors  affecting  visual  sensor  performance  in  the 
atmosphere  include  target  contrast,  scattered  path  Ituninance,  luminance 
magnitude,  visual  range,  sun  position  relative  to  the  sensor,  refractive  turbulence, 
and  target  size  and  range.  A  common  method  for  evaluating  visual  sensor 
performance  is  to  establish  the  probabihty  of  target  detection  as  a  function  of 
target,  atmosphere,  and  sensor  parameters.  Figure  2-4  illustrates  typical 
probability  of  detection  curves  for  eye  and  daysights,  a  starlight  scope,  and  night 
vision  goggles  viewing  targets  on  different  backgrounds  (representing  different 
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Figure  2-4.  Typical  probability  of  detection  curves  for  visual/near-infrared  band  imaging  systems. 


values  of  contrast)  as  a  function  of  relative  path  transmittance  (transmittance 
normalized  to  that  for  no  image  attenuation).  This  figure  shows  that  as  the  target 
contrast  increases,  the  relative  transmittance  corresponding  to  the  50  percent 
probability  of  detection  decreases.  Increases  in  target  contrast  mean  increases  in 
target  range  for  50  percent  probabihty  of  detection,  or,  if  range  is  fixed,  the  target 
is  detected  under  much  lower  visual  ®ange  conditions.  Note  that  sensor 
probability  of  detection  depends  on  sensor  type  as  well  as  target  contrast.  It  is 
important  to  keep  careful  records  of  the  operational  characteristics  of  sensors 
being  tested. 

Table  A-1  suggests  a  nominal  acceptable  error  necessary  for 
characterization  of  the  probability  of  target  detection  with  a  visual  imaging 
system.  As  explicit  computations  show,  this  nominal  value  may  be  more  or  less 
than  is  required  for  an  accurate  probabihty  of  detection  estimate. 


2.2.2  Infrared  Sensor  Tests.  Evaluation  of  imaging  sensors  in  the  3-5  pm  and 
8-14  pm  spectral  bands  requires  meas\irement  of  atmospheric  parameters  that 
affect  radiometric  emission  and  absorption  of  background  radiation  at  the  target 
and  along  the  target  path.  Thus,  it  is  important  that  infi-ared  gaseous  absorption 
be  determined  primarily  in  the  water  vapor  and  carbon  dioxide  bands.  This 
absorption  requires  careful  measiirement  of  temperature,  pressure,  and  humidity. 
There  is  no  atmospheric  "visibihty"  parameter  for  the  infi'ared  bands,  because 
there  is  no  standard  spectral  response  in  the  infi'ared  as  there  is  in  the  visual 
where  human  eye  response  is  the  standard.  The  equivalent  parameter  in  the 
infi'ared  is  spectral  transmittance  as  it  applies  to  a  particular  sensor’s  spectral 
response.  If  sensor  spectral  response  is  assumed  constant  with  respect  to  wave¬ 
length,  then  spectral  transmittance  can  be  computed  in  terms  of  air  temperature, 
relative  humidity,  and,  for  specification  of  aerosol  content,  visual  range. 

Target  contrast  is  especially  difficult  to  determine  in  the  infrared  and  is 
often  reported  in  terms  of  "target-backgroimd  temperature  difference."  It  is 
generally  understood  that  this  "temperatiu'e  difference"  is  a  "brightness 
temperature  difference."  Brightness  temperature  difference  is  an  equivalent 
temperature  difference  proportional  to  the  radiometric  emission  and  reflection 
difference  between  target  and  backgrovmd.  When  the  spectral  emissivity  (emitted 
radiance  relative  to  that  of  a  black  body  at  the  same  thermodynamic  temperatme) 
of  the  target  and  background  are  identical,  it  is  commonly  assumed  that  the 
brightness  temperature  difference  is  directly  proportional  to  thermodynamic 
temperature  difference.  However,  target  and  background  emissivities  are  rarely 
identical.  Assuming  equal  target  and  background  emissivities,  when  they  are  in 
fact  different,  can  lead  to  errors  of  himdreds  of  percent  in  predicted  estimates  of 
thermal  contrast.  Unless  target  and  backgroimd  spectral  emissivities  are 
measxired  in  addition  to  thermodynamic  temperatures,  the  observed  target-to- 
backgroxmd  thermal  contrast  is  scene-  and  sensor-spedfic.  As  a  consequence,  the 
test  results  can  not  be  accurately  extrapolated  to  other  targets  of  similar  size, 
shape,  and  "color"  in  comparable  backgroxmd  scenes. 
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Measurement  results  cannot  be  applied  directly  to  similar  sensors  in  the 
same  spectral  band  unless  the  new  sensor  has  the  same  spectral  response  as  the 
tested  sensor.  Sensor  output  is  an  integral  response  to  the  product  of  all  factors 
affecting  theMspectral  band  in  which  the  sensor  operates.  These  factors  include 
spectral  emissivity  of  the  target  and  backgroimd,  atmospheric  spectral  extinction, 
and  the  spectral  response  of  the  sensor  optics  and  photodetector.  If  sensors  are 
changed,  even  though  the  spectred  band  remains  the  same,  the  sensor  output  will 
change  for  the  same  input  values,  because  the  new  sensor  spectral  response,  if 
different  from  the  original  sensor,  weights  the  inputs  differently.  Broad  band 
atmospheric  transmittance,  for  example,  is  sensor  specific  for  the  same  reason. 

Infrared  imager  sensor  sensitivity  is  often  expressed  in  terms  of  "minimum 
resolvable  temperature  difference"  (MRTD).  However,  MRTD  is  sensitive  to  the 
magnitude  of  the  radiometric  energy  input,  making  sensor  performance  sensitive 
to  the  square  of  the  Hne-of-sight  transmittance.  Thus,  it  is  nearly  impossible  to 
separate  sensor  response  characteristics,  target-background  thermal  contrast,  and 
atmospheric  effects  in  the  evaluation  of  sensor  performance  in  the  atmosphere. 
Atmospheric  testing  must  ensure  that  all  significant  variables  relative  to  sensor 
performance  are  acqmred. 

Figure  2-5  illustrates  the  effects  of  target  thermal  contrast  and  atmospheric 
transmittance  on  the  probability  of  detection  of  a  tank  target  set  against  a 
grass-covered  background.  Note  that  thermal  contrast  varies  strongly  as  a 
fimction  of  time  of  day  (the  primary  source  of  background  temperature  is  the  sun). 
Transmittance  is  normalized  to  that  for  no  atmospheric  attenuation.  Table  A-2 
defines  the  parametric  characteristics  that  should  be  determined  in  atmospheric 
evaluation  of  infrared  imaging  systems  in  the  context  of  50  percent  probability  of 
detection.  Key  factors  eiffecting  infrared  imager  tests  in  the  atmosphere  are 
spectral  transmittance  in  relation  to  sensor  spectral  response,  air  temperature, 
relative  humidity,  visual  range,  thermodynamic  temperatures  for  target  and 
backgroimd,  spectral  emissivities  for  target  and  background,  sensor  spectral 
response  and  radiometric  sensitivity,  and  target  range  and  size. 


2.2.3  Laser  Range  Finder  Tests.  The  narrow  operating  spectral  band  and  its 
spectrum  location  determine  the  most  significant  atmospheric  factors  affecting 
Laser  Range  Finder  (LRF)  performance.  The  most  common  military  LRF  systems 
operate  at  1.06,  1.54,  or  10.6  pm  wavelengths.  The  performance  of  those  systems 
operating  in  the  near-infrared  (1.06  and  1.54  pm)  is  most  sensitive  to  attenuation 
by  atmospheric  aerosols  and  refractive  turbulence.  Tbe  10.6  pm  system  is  most 
sensitive  to  attenuation  by  gaseous  absorption  and,  hence,  to  air  density, 
temperature,  pressme,  and  humidity.  It  is  not  nearly  as  sensitive  to  refractive 
turbulence  as  the  near-infrared  systems.  All  three  systems  are  sensitive  to  the 
magnitude  of  backgroimd  radiation,  because  sensor  detector  signal-to-noise  is 
affected.  The  LRF  system  response  is  determined  by  target  spectral  reflectivity 
rather  than  target-to-backgroimd  contrast. 
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Figure  2-5.  Example  of  8-14  pm  band  FLIR  probability  of  detection  of  a  tank  on  a  grass  background  as  a  function 
of  time  of  day. 


Figure  2-6  illustrates  the  probability  of  successful  ranging  for  a  1.06  pm 
LRF  for  20  km  of  visual  range,  3  percent  target  reflectivity,  no  refractive 
turbulence,  and  no  background  radiation  as  a  function  of  target  range  and  relative 
transmittance  through  a  smoke  screen.  Figure  2-6  shows  that  the  50  percent 
probability  of  successfrd  ranging  is  a  sensitive  function  of  target  range  and 
transmittance  through  the  smoke  screen.  It  is  particularly  important  to 
accurately  measure  transmittance  between  target  and  sensor  for  these  systems. 
Table  A-3  lists  the  atmospheric  parameters  that  should  be  measured  for  1.06, 

1.54,  and  10.6  pm  LRF  systems  in  the  context  of  probability  of  successful  ranging. 
As  with  broad  band  electro-optical  systems,  it  is  important  that  the  operating 
characteristics  of  the  LRF  system  under  test  be  recorded  so  that  the  atmospheric 
and  target  parameters  be  applicable  to  other  systems. 


2.2.4  Millimeter  Wave  Sensor  Tests.  Millimeter  wave  sensor  systems  are 
much  less  sensitive  them  visual  or  infrared  systems  to  attenuation  resulting  from 
normally  occurring  atmospheric  particulates  or  refractive  turbulence.  Millimeter 
wave  systems  are  particularly  sensitive  to  radiometric  absorption  by  hquid  water 
and  water  vapor.  Thus,  millimeter  wave  transmission  is  a  sensitive  function  of  air 
temperature,  pressme,  and  humidity.  While  insensitive  to  refractive  index 
txu'bulence,  this  spectral  band  is  particvilarly  sensitive  to  relative  humidity 
t\nbulence  which  is  proportional  to  refractive  index  turbulence.  In  equation  2-1, 
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Cn,  Cj,  and  Cq  are  so-called  structure  constants  for  refractive  index,  temperature, 
and  humidity  fluctuations  because  of  atmospheric  tiurbulence.  Ap  and  Aq  are 
constants  that  are  wavelength  dependent.  As  wavelength  increases,  Aj  decreases 
and  Aq  increases.  The  cross-correlation  between  temperature  and  humidity  effects 
is  represented  by  the  last  term  in  equation  2-1.  This  term  plays  a  particularly 
important  role  in  defining  turbvilence  effects  on  millimeter  wave  propagation  when 
there  is  high  variability  in  temperature  and  humidity  along  the  propagation  path. 
At  the  shorter  wavelengths,  temperature  eflects  are  dominant,  while  at  the  longer 
wavelengths,  humidity  effects  dominate.  The  end  result  is  that  refractive 
tiu'biilence  effects  can  be  as  strong  for  millimeter  wave  propagation  as  those  at  the 
shorter  wavelengths  but  for  entirely  different  reasons.  The  shorter  wavelengths 
imdergo  scintillation  because  temperature  fluctuations  of  the  air  refract  the 
transmitted  beam.  The  longer  wavelengths  undergo  scintillation,  because 
humidity  varies  causing  fluctuations  in  transmitted  beam  absorption. 
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a  1.06  viin  LRF  for  20  km  of  visual  range,  3  pei 
no  background  radiation  as  a  function  of  targe 
)ke  screen. 


Target  and  background  signatures  are  sensitive  to  dew,  frost,  and  the  liquid 
water  content  in  snow  cover,  precipitation,  and  clouds;  therefore,  background  and 
target  emissivity  becomes  as  important  in  the  millimeter  wavelength  band  as  in 
the  infrared  bands.  Precipitation  temperature  is  a  uniquely  important  parameter 
for  this  spectral  band,  even  though  it  can  be  neglected  in  other  bands,  because 
spectral  absorption  is  temperature  dependent  and  changes  drasticaUy  between  ice 
and  water. 

The  characterization  of  natural  hydrometer  effects  on  electromagnetic  wave 
propagation  in  the  millimeter  wave  and  microwave  bands  is  critical  in  atmospheric 
evaluation  of  these  sensors.  For  example,  polarization  used  to  increase  the 
information  transmitting  capacity  of  millimeter  wave  systems  is  affected  by  the 
orientation  of  raindrops.  Falling  raindrops  are  shaped  like  oblate  spheroids  that 
become  canted  at  particular  angles  by  surface  and  aloft  winds.  The  canting  angle 
affects  commtmication  channel  "leakage"  in  both  horizontal  ground  level  and 
vertical  satellite  transmission  paths.  Snow  crystal  preferred  orientation  effects  at 
high  altitudes  are  commonly  observed  as  rings  aroimd  the  moon.  These 
orientations  also  occur  near  the  surface  and  can  strongly  affect  sensor 
performance.  Particle  orientation  is  driven  by  background  winds  and  turbulence 
and  must  be  measured  accmately  with  high  spatial  and  temporal  resolution. 

Thus,  atmospheric  testing  of  millimeter  wave  sensor  systems  requires  greater 
attention  to  details  relevant  to  natural  hydrometers  than  the  visual  and  infrared 
systems.  Table  A-4  provides  a  svunmary  of  the  parameters  needed  for 
measmement  as  a  function  of  millimeter  wave  transmission  characterization. 


2.2.5  Test  Programs.  Electro-optical  sensor  atmospheric  test  programs  share 
many  common  featiues  and  data  requirements  regardless  of  which  DOD  agency  is 
testing  the  sensor.  The  common  thread  is  the  type  of  sensor  being  tested.  To 
illustrate  electro-optical  test  program  data  reqmrements.  Army,  joint  DOD  agency, 
and  general  Navy/Marine  littoral  warfare  testing  programs  are  discussed  in  the 
subparagraphs  that  follow. 


2.2.5. 1  SWOE  Test  Program.  The  Smart  Weapon(s)  Operability  Enhancement 
(SWOE)  program  started  in  1989  and  is  sponsored  by  the  U.S.  Army  Corps  of 
Engineers  (the  lead  service),  the  individual  services,  and  the  Joint  Test  and 
Evaluation  (JT&E)  program  of  the  Office  of  the  Director  for  Test,  Systems 
Engineering  and  Evaluation  (DTSE&E),  Office  of  the  Secretary  of  Defense  (OSD). 
The  SWOE  is  intended  to  develop,  validate,  and  demonstrate  the  capability  of  an 
integrated  process  to  handle  complex  ground  target  signatiues  and  worldwide 
operating  environment  effects.  This  process  will  provide  the  DOD  smart  weapons 
and  aided  target  recognition  (ATR)  developers  with  reliable  methods  to  integrate 
measurement,  information  base,  modeling,  and  scene  rendering  techniques  for 
complex  environments.  The  SWOE  measurements  are  intended  as  basic  inputs  for 
"first  principles"  models  that  predict  ground  target  image  characteristics  in 
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multispectral  sensors,  meaning  that  environmental  measurements  must  be  of  the 
highest  possible  quality  and  sampled  at  a  rate  that  provides  averaging  for  effective 
signal-to-noise  improvement  and  avoidance  of  abasing  effects.  Table  A-5  provides 
a  summary  of  the  parameters  required  by  SWOE  first  principles  imaging  models. 
Reference  7  should  be  consulted  for  more  detailed  programmatic  information. 


2.2.5.2  Smoke  Week  Test  Program.  The  Smoke  Week  test  program  is  intended 
to  provide  weapons  systems  electro-optical  sensor  developers  a  characterized 
environment  in  which  to  evaluate  sensor  performance  against  smoke  and 
obscurant  coimtermeasures.  A  Smoke  Week  test  requires  measurement  of  target 
signatures,  atmospheric  characteristics  including  the  attenuation  and  transport 
and  diffusion  characteristics  of  smoke  and  obscurant  coimtermeasures,  and  the 
performance  of  the  sensor  during  the  countermeasure  event.  These  tests  include 
multispectral  imaging  systems,  multiwavelength  laser  range  finders  and 
designators,  millimeter  wave  systems,  and  smokes  and  obscurants  developed  to 
coimter  the  effectiveness  of  these  systems  against  realistic  targets.  Smoke  and 
obscurant  tests  are  among  the  most  dynamic  events  encountered  in  electro-optical 
sensor  testing  in  the  atmosphere  and  are  among  the  most  challenging.  Sampling 
periods  may  be  10  Hz  or  higher  for  atmospheric  transmission  and  for  sensor 
response  measurements  with  averaging  periods  that  run  to  seconds  or  tens  of 
seconds.  The  steepness  of  the  probability  of  detection  curves  shown  in  figimes  2-4, 
2-5,  and  2-6  (see  paragraph  2.4)  suggests  that  data  accuracy  needs  to  be  high  to 
properly  quaHfy  sensor  performance.  Table  A-6  shows  the  parameters  typically 
acquired  in  Smoke  Week  tests.  References  8  and  9  are  sample  documents 
describing  these  test  programs. 


2. 2.5.3  Littoral  Warfare  Testing.  Littoral  warfare  testing  requires  that  electro- 
optical  sensors  be  tested  in  the  atmosphere  at  the  land-sea  interface  where  there 
are  strong  diurnal  meteorological  effects  and  atmospheric  variables  which  can 
change  rapidly  and  often.  Sensor  performance  can  be  significantly  different  for 
the  same  propagation  path  when  transmitted  from  a  land-  or  a  sea-based 
platform,  because  atmospheric  aerosol  loading  and  refractive  index  structure 
constants  can  be  drastically  different  between  sea  surface  propagation  and  land 
propagation.  Thus,  testing  electro-optical  sensors  in  a  littoral  environment  is 
complex  and  challenging.  Littoral  testing  requires  that  data  be  acquired  at  high 
rates,  that  detailed  measxu*ements  be  made  along  the  propagation  path  over  land 
and  sea,  and  that  the  sensor  be  evaluated  for  operation  from  either  end  of  the 
propagation  path.  In  many  cases,  there  is  little  or  no  historical  data  to  support 
this  testing,  and  instrumentation  to  support  measurements  made  only  over  the 
groimd  are  hkely  to  be  highly  limited  in  operational  capability  over  a  land-sea 
interface.  Appendix  A-7  shows  the  parameters  that  require  measurement  in  a 
littoral  test  program. 
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2.3  RECOMMENDED  MEASUREMENT  METHODS 


This  section  discusses  recommended  measurement  methods  for  the 
parameters  required  to  characterize  electro-optical  sensor  performance  in  the 
atmosphere  for  the  types  of  sensors  and  test  :  discussed  in  paragraph  2.2.  These 
recommendations  are  intended  to  be  guidelines  that  will  help  the  user  ask  the  test 
customer  the  proper  TQDM-related  questions  to  ensure  that  sufficient  data  are 
acquired,  that  the  data  are  of  sufficient  accuracy  for  the  sensor  test,  and  that  the 
data  will  be  of  sufficient  quality  to  be  used  with  assurance  in  future  applications. 


2.3.1  Visual  Range  (Visibility).  Visual  range,  or  visibility,  is  a  shorthand 
specification  for  atmospheric  contrast  transmittance  when  the  sensor  is  assumed 
to  be  the  human  eye.  It  is  one  of  the  most  misapplied,  miswderstood,  and 
incorrectly  measured  parameters  in  field  evaluation  of  electro-optical  sensors. 
Visual  range  is  a  function  of  atmospheric  attenuation,  absolute  magnitude  of 
backgroimd  illumination,  scatter  and  absorption  of  backgroimd  illiunination  along 
the  observation  path,  target  contrast  without  path  attenuation  and  path 
illmnination  effects,  and  sensor  contrast  threshold. 

Definitions  of  terms  relative  to  visual  range  vary  throughout  the  literature. 
Definitions  that  are  assiuned  for  these  guidelines  are  commonly  used  in 
atmospheric  testing  of  electro-optical  sensors.  Contrast  is  defined  as  the 
difference  between  maximum  and  minimmn  target  luminance  divided  by  the 
backgroimd  luminance  (ref  10).  Visual  range  is  the  distance  at  which  an  object 
with  unit  target  contrast  can  be  detected  with  a  50  percent  probability  of 
detection.  It  is  important  that  the  telephotometer  used  to  measure  contrast  have 
a  photopic  spectral  response.  Photopic  spectral  response  is  the  eye  response  of  the 
cones  in  the  retina  and  occurs  after  the  eyes  have  become  adapted  to  a  field 
luminance  equal  to  or  greater  than  about  3  cemdles/m^  (ref  11).  Photopic  spectral 
response  peaks  around  560  nm  and  falls  to  10  percent  of  the  peak  at  about  470 
nm  for  the  short  wavelength  and  685  nm  for  the  long  wavelength  ranges  of  the 
spectrum. 

Path  luminance  is  often  expressed  in  terms  of  the  ratio  of  horizon  sky  (S)  to 
background  luminance  (G):  the  sky-to-ground  ratio  (S/G).  In  the  special  case 
where  the  sky-to-groimd  ratio  is  1,  the  contrast  transmission  (ratio  of  zero  path 
contrast  to  observed  contrast)  is  identical  to  radiometric  transmission  described  by 
the  Beer-Bouguer  law.  The  visual  range,  or  visibility,  is  then  computed  by 
assuming  some  contrast  detection  threshold  limit  and  solving  the  Beer-Bouguer 
transmission  equation  for  the  range  equivalent  to  an  atmospheric  attenuation 
value  expressed  in  terms  of  the  volrune  extinction  coefficient,  which  is  the 
so-called  Koschmieder  law.  Values  of  the  contrast  detection  threshold  commonly 
assumed  for  the  Koschmieder  relationship  are  0.02  or  0.05. 
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Unfortunately,  the  sky-to-ground  ratio  is  rarely  1  and  is  sensitive  to  path 
orientation  relative  to  sun  position.  Thus,  a  visual  range  estimate  using 
Koschmieder’s  relationship  is  often  in  error.  Figure  2-7  shows  how  the 
line-of-sight  path  direction  can  easily  produce  wide  variations  in  the  sky-to-groimd 
ratio.  Figure  2-8  quantitatively  illustrates  the  impact  of  this  problem.  Figure  2-8 
plots  observable  visual  range  relative  to  that  predicted  by  Koschmieder’s 
relationship  for  a  0.02  contrast  detection  threshold.  Koschmieder’s  law  gives  the 
observable  visual  range  when  the  sky-to-groxmd  ratio  is  1.  When  the 
sky-to-ground  ratio  is  less  than  1  (for  example,  snow-covered  ground  imder 
overcast  sky  as  shown  in  figure  2-7),  the  visual  range  is  greater  than  predicted, 
and  the  visual  range  is  less  than  predicted  when  the  sky-to-groimd  ratio  is  greater 
than  1.  The  magnitude  of  the  incorrect  estimate  depends  on  the  contrast  detection 
threshold  which,  in  the  Koschmieder  relationship,  is  assumed  to  be  0.02  or  0.05. 
Ultimately,  the  magnitude  of  the  environmental  illximination  determines  the 
contrast  detection  threshold.  The  contrast  sensitivity  of  the  human  eye  depends 
on  the  magnitude  of  object  illuminance.  The  theoretical  contrast  detection 
threshold  (for  a  bright  sunht  background)  for  a  50  percent  probabihty  of  detection 
is  roughly  an  order  of  magnitude  smaller  than  the  Koschmieder  values  (ref  9). 
Thus,  to  obtain  an  accurate  value  of  visual  range,  the  following  parameters  must 
be  measured: 

1.  absolute  magnitude  of  the  target-background  liiminance  (used  to 
determine  limiting  contrast  threshold  of  human  eye  for  50  percent 
probability  of  detection), 

2.  radiometric  transmittance  of  the  atmosphere  for  photopic  eye  spectral 
response, 

3.  horizon  sky  luminance  immediately  above  the  target  (required  for 
sky-to-groxmd  ratio), 

4.  backgroxmd  Iximinance  aroxmd  the  target  (required  for  sky-to-groxmd 
ratio), 

5.  near  target  contrast  (negligible  path  effects)  (reqxiired  for  contrast  ratio), 
and 

6.  target  contrast  at  desired  range  (reqxiired  for  contrast  ratio). 

Radiometric  transmittance  must  be  measxired  near  the  line  of  sight  to  the 
target  but  with  the  transmissometer  soxirce  outside  the  field  of  view  of  the 
telephotometer  used  to  measxire  sky-to-groxmd  ratio  to  avoid  biases  in  backgroxmd 
illximination  created  with  the  artificial  transmissometer  soxirce.  The  spectral 
response  of  the  transmissometer  must  include  the  soxirce  characteristics  as  well  as 
the  optical  system  transmittance,  the  photopic  filter,  and  the  response  of  the 
photodetector.  Radiometric  transmittance  is  computed  by  normalizing  the 
measxired  radiometer  output  obtained  for  the  desired  range  to  that  for  a 
nonattenuating  atmosphere.  The  normalization  must  include  the  effects  of  soxirce 
divergence  and  transmitter  beam  homogeneity  for  the  two  different  measurement 
ranges. 
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2-7.  Illustration  of  the  dependence  of  sky  (S)-to-ground  (G)  illuminance  ratio  on  viewing  direction 
Visual  range  depends  inversely  on  sky-to-ground  illuminance  ratio  (S/G). 


100 
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VISIBILITY  (KOSCHMIEDER  LAW),  km 


Transmissometer  and  telephotometer  calibration  should  follow  the  National 
Institute  of  Standards  and  Tedmology  (NIST)  standards  that  define  methods  for 
measuring  instrument  spectral  response  and  operational  characteristics  of 
calibration  lamps  (ref  3).  Attention  must  also  be  given  to  contrast  targets. 

Normal  aging  and  "weathering"  cause  target  contrast  to  decrease.  Environments 
with  high  atmospheric  dust  concentrations  or  precipitation  levels  affect  target 
contrasts  at  much  higher  rates  (daily  changes  may  be  notable)  than  those  where 
these  values  are  small  because  the  target  collects  ambient  dusts  and  aerosols  to 
which  it  is  exposed.  Thus,  contrast  targets  operating  in  low  visual  range 
environments  need  to  be  calibrated  much  more  often  than  those  operating  in  high 
visual  ranges  to  compensate  for  increased  collection  of  dust  and  other  aerosols  on 
the  target  surface. 


2.3.1.1  Solar  Position.  Solar  position  is  most  easily  determined  by  an  accurate 
survey  of  measirrement  position  on  the  earth’s  surface  and  measurement  of  time 
and  date  with  respect  to  local  time  or  UTC  time.  Equations  for  computing  sun 
position  are  available  in  the  Smithsonian  Meteorological  Tables  List  (1958). 
Computer  programs  in  spread  sheet  format  are  available  that  specify  solar 
position  within  fractions  of  a  minute  given  latitude,  longitude,  and  time  of  day  and 
date.  Accimate  solar  position  specification  relative  to  a  line  of  sight  requires  an 
accurate  site  survey  of  all  instrumentation  locations  and  an  accurate  record  of 
local  time. 


2.3.1.2  Cloud  Cover.  Cloud  cover  is  the  fraction  of  the  upward  hemisphere  (sky) 
obsciu'ed  by  clouds  as  observed  from  ground  level.  Cloud  cover  is  an  estimate  of 
the  fraction  of  the  sky  contributing  to  grotmd-level  illumination  through  direct 
illumination  and  indirectly  through  diffuse  illmnination  filtered  through  clouds. 
For  quantitative  computations,  it  is  useful  to  specify  the  cloud  cover  in  terms  of 
sky  hemisphere  sectors  that  subtend  equal  solid  angles  to  a  groimd-level  observer. 
Once  the  number  of  sectors  is  chosen,  their  midpoint  locations  (denoted  by  a 
subscript  i)  can  be  computed  (ref  4).  The  result  is 


c,  =  (i-1) 
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azimuth 
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where  m  is  the  desired  number  of  azimuth  sectors  and  n  is  the  number  of  zenith 
sectors.  By  choosing  a  "sufficient"  number  of  azimuth  smd  zenith  sectors,  cloud 
cover  can  be  specified  to  as  high  or  as  low  a  precision  as  necessary. 


2-35 


Cloud  cover  can  be  recorded  with  a  camera  (video  or  film)  using  a  fish  eye 
lens  and  analyzed  after  a  test  is  complete.  However,  if  such  a  measurement  is 
performed,  the  lens  must  be  calibrated  in  terms  of  its  solid  angle  projection  onto 
the  flat  surface  of  the  recordings  ipiedium.  An  automated  technique  such  as  this  is 
much  preferred  to  manual  obs©e\^ons  which  are  labor  intensive  and  low  in 
accuracy.  5  -,  - 

Specification  of  cloud  characteristics  is  particuleirly  crucial  for  electro-optical 
testing  of  airborne  sensors.  Cloud  characteristics  range  fi*om  size  to  concentra¬ 
tions  of  water  and  ice  to  types  and  distributions  of  particles.  The  details  of  these 
characteristics  encompass  a  large  body  of  literature  and  ongoing  research  that  are 
beyond  the  scope  of  these  guidehnes.  Excellent  sumnmries  of  information  on  this 
subject  are  given  in  references  12  and  13. 


2.3.2  Wind.  Wind  is  a  fimdamental  parameter  that  affects  aerosol  and 
precipitation  transport  and  diffusion,  the  spread  of  transmitted  beam  energy,  and 
target  signatures  (in  the  thermal  infi-ared).  It  is  a  highly  dynamic  vector 
phenomenon  and  can  vary  strongly  as  a  function  of  stuface  position  and  time.  It 
is  important  the  three  orthogonal  vector  components  of  wind  be  measured  at  a 
sampling  frequency  that  does  not  alias  the  descriptive  statistics  for  each  velocity 
component  and  the  potential  for  obtaining  aliased  results  be  controlled  by  using 
proper  data  filters  or  averaging  methods.  Often  it  is  important  or  useful  for  one  of 
the  orthogonal  wind  components  to  be  oriented  along  the  line  of  sight.  The  mean 
and  standard  deviations  for  each  wind  velocity  component  eu’e  required.  The 
number  of  measurements  per  component  for  a  statistically  stable  value  depends  on 
the  turbtdence  intensity;  the  number  of  spatial  points  measm’ed  depends  on 
stability  of  the  atmosphere  required  for  evaluation  of  the  sensor  system  and  how 
the  data  will  be  applied  in  its  analysis. 

A  usefiil  "rule  of  thiunb"  for  the  number  of  measurements,  N,  for  example, 
to  be  averaged  in  a  single  point  sample  for  a  required  coefficient  of  variation,  C,  is 


where  c/p  is  the  turbiilent  intensity  (standard  deviation/mean  speed).  As  an 
example  in  the  appHcation  of  equation  2-4,  assume  a  95  percent  confidence  level  is 
required  for  the  data  mean  (the  coefficient  of  variation  is  0.05).  A  20  percent 
txirbulence  intensity  then  requires  that  16  data  points  must  be  sampled  to  ensime 
a  95  percent  confidence  level  in  the  computed  mean.  It  should  be  imderstood  that 
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the  rule  of  thumb  given  by  equation  2-4  is  a  simplification  of  a  complicated 
problem  having  many  features.  Refer  to  reference  14  for  additional  details  on 
sampling  requirements  for  meteorological  instrumentation  and  data  quabty 
control. 

The  location  of  wind  measurement  stations  in  a  test  grid  depends  on  the 
type  of  electro-optical  sensor  being  evaluated  and  the  data  application.  For 
example,  in  the  thermal  infrared  bands,  target-backgroimd  thermal  contrast 
observable  with  a  FLIR  depends  on  wind  speed  particularly  for  low  values  of 
thermal  contrast,  because  target  and  backgroimd  thermodynamic  temperatures 
are  affected  by  backgroimd  winds.  Thus,  a  measurement  station  should  be  within 
at  least  one  wind  speed  correlation  length  of  the  target.  A  correlation  length  is 
the  distance  over  which  two  similar  measurements  (for  example,  wind  speed  or 
scintillation)  can  be  sampled  and  expected  to  produce  correlations  better  than 
0.36.  Image  resolution  depends  on  refractive  turbulence  effects  which  is  an 
integrated  path  result.  Wind  speed  variations,  in  this  case,  are  important  down 
the  line  of  sight  and  must  be  measured  with  a  closely  spaced  meteorological  sensor 
array  down  the  line  of  sight  or  with  a  scintillometer.  On  the  otiier  hand,  when 
laser  range  finders  are  evaluated,  correlation  leng^s  have  a  different  impact  on 
test  results.  For  example,  laser  range  finder  target  reflectivity  is  not  directly 
affected  by  wind  or  temperature  as  is  a  thermal  contrast  signature,  but  the 
amount  of  power  illiuninating  the  target  is  affected  by  scintillation.  The 
scintillation  can  be  represented  by  a  turbulence  scale  length  distribution  which  is 
a  measure  of  turbulence  eddy  sizes  and  represents  a  length  over  which 
scintillation  effects  can  be  correlated.  Wind  speed  within  a  correlation  length  of 
the  target  is  not  critical  for  laser  range  finder  target  characterization;  however, 
scintillation  characterization  in  terms  of  turbulence  scale  length  distributions 
down  the  line  of  sight  is  required  to  specify  LRF  performance. 

Spatial  separation  of  wind  measurement  stations  for  a  particular  level  of 
acceptable  error  depends  on  atmospheric  stability  and  the  orientation  of  the  sensor 
line  of  sight  with  respect  to  the  wind  vector.  For  lines  of  sight  perpendicular  to 
the  wind  vector  and  for  flat  terrain,  it  is  normally  assumed  (and  often  erroneously) 
that  the  wind  speeds  are  relatively  uniform  down  the  line  of  sight.  The 
correlation  functions  depend  on  surface  roughness  and  the  height  above  ground 
level  at  which  the  measurements  are  to  be  made,  that  is,  the  sensor  hne  of  sight. 
For  example,  rough  estimates  of  the  integral  length  scales  (the  distance  over 
which  tiubulence  spectra  energy  remains  correlated  to  a  value  of  0.36  or  better) 
over  level  terrain  in  the  direction  of  the  wind  vector  are  about  10.3  z  (z  is  the  line 
of  sight  height).  Perpendicular  to  the  wind  vector,  it  is  about  7.5  z;  vertically,  it  is 
0.5  z;  and  for  the  mean  direction  it  is  8.4  z  for  a  "C"  or  "D"  Pasquill  atmospheric 
stability  category  (ref  15,  16).  These  estimates  show  that  if  a  laser  range  finder 
line-of-sight  is  2  m  above  ground  level  and  perpendicular  to  the  wind  direction,  a 
parallel  line  of  sight  sensor  such  as  a  scintillometer  must  be  within  20.6  m  of  the 
laser  line  of  sight  in  the  upwind  or  downwind  direction  and  within  1  m  of  height  if 
there  is  to  be  correlation  of  the  measurements  with  the  response  of  the  laser  range 
finder  to  turbulence  effects. 
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2.3.2. 1  Wind  Speed  and  Direction  at  Surface.  Horizontal  wind  components 
measured  at  the  meteorological  stations  in  the  sampling  array  are  sampled  to 
interpolate  between  spatial  measurement  points  to  simulate  the  horizontal 
variation  of  the  wind  field.  Near-surface  mean  wind  speeds  can  be  measured 
reasonably  with  mechanical  anemometers  (cup  or  propeller).  According  to  Lyons 
and  Scott,  these  shoxild  be  "..accurate  within  0.2  m/s  ±5  percent  of  the  wind  speed, 
with  a  start  speed  of  less  than  0.5  m/s,  and  a  distance  constant  (63  percent 
recovery)  of  less  than  5  m.  Wind  vanes  should  have  a  resolution  of  1°  and  em 
accuracy  of  5°  (ref  16).  Delay  distance  (50  percent  recovery)  must  be  less  than  5  m 
with  a  damping  ratio  of  greater  than  0.4.  Sixty  or  more  samples  will  estimate 
hourly  means  to  within  5-10  percent.  Sample  averaging  time  should  be  1-5  s  with 
a  response  time  of  at  least  1  s.  At  least  360  samples  are  required  to  estimate  the 
hourly  deviation  within  5-10  percent"  (ref  15,  16). 


2.3.2.2  Winds  Aloft  and  Mixing  Laver  Height.  Winds  aloft  are  determined 
using  tower  moimted  anemometers  and  vanes,  pilot  balloons,  radiosondes,  acoustic 
soimders,  radar  profilers,  and  rocketsondes.  Global  positioning  technology  added 
to  pilot  balloons  and  small  rocketsondes  provides  spatial  resolution  capability  of 
±2-3  m.  This  capability  provides  measurement  of  high  altitude  wind 
characteristics  that  is  commensurate  with  measurements  made  on  towers. 

The  height  of  the  mixing  layer  is  a  fimdamental  parameter  in  character¬ 
izing  the  stability  of  the  atmosphere.  Atmospheric  stability,  for  example,  is  used 
to  define  transport  and  diffusion  parameters  for  electro-optical  sensor  passive 
coxmtermeasures  such  as  smokes  and  obscurants  or  for  specifying  luflYimnm 
acceptable  line-of-sight  separation.  This  height  can  be  detected  by  observing  rapid 
changes  in  temperature  gradient  or  wind  shear  using  continuous  monostatic  and 
Doppler  acoustic  soxinders  that  measure  two-way  acoustic  propagation  time. 

These  data  are  normally  correlated  with  tethered  sonde  or  airborne  sensors. 
Acoustic  sounders  normally  have  spatial  resolutions  of  about  30  m  with  a  useful 
range  of  about  50-600  m  above  groimd  level.  Resolutions  of  1.5-3  m  can  be 
obtained  by  using  pulsed  laser  systems  (for  example,  hdar  or  the  visioceilometer 
developed  by  the  U.S.  Army)  that  detect  scatter  from  aerosols  which  concentrate 
in  the  mixing  layer.  The  FM/CW  radar  that  detects  backscatter  fi-om  changes  in 
relative  humidity  associated  with  the  mixing  layer  height  offers  the  potential  for 
all  weather  operation,  high  spatial  and  tempor^  resolution,  and  acciiracy. 


2.3.2.3  Atmospheric  Stability.  Atmospheric  stability  is  often  expressed  in 
terms  of  A-F  Pasquill  stability  categories  (ref  4).  Atmospheric  stability  can  be 
computed  from  the  vertical  temperature  gradient,  wind  direction  fluctuations, 
sensible  heat  flux,  wind  speed,  and  surface  roughness,  or  global  solar  radiation, 
wind  speed,  dry  btilb  temperature,  and  optical  scintillation  (ref  17,  18). 
Measurement  of  atmospheric  stability  using  temperature  gradients  requires  at 
least  0.1  °C  accuracy  and  0.02  °C  resolution.  The  temperature  probe  should  have 
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at  least  63  percent  recovery  in  1  minute  for  these  kinds  of  measurements.  Higher 
sampling  rates  (0.1  Hz)  with  thin  film  probes  are  highly  desirable.  Accuracy  and 
resolution  requirements  of  these  measurements  are  highest  for  wind  speeds  of  1-3 
m/s  meastu’ed  at  a  10  m  height  and  for  sensible  heat  fluxes  less  than  about  60 
W/m2  (ref  17).  This  conceptual  method  begins  to  fail  for  very  low  wind  speeds  and 
quiescent  conditions  pxmctuated  by  intermittent  turbulence. 


2.3.3  Absorbing  Gases.  Atmospheric  gases  that  impact  electro-optical  system 
performance  are  primarily  water  vapor,  ozone,  carbon  dioxide,  and  nitrogen  oxide. 
Absorption  by  these  gases  occurs  near  the  3-5  and  8-14  pm  bands.  Nearly  all 
electro-optical  sensors  have  been  designed  to  operate  in  spectral  bands  that  avoid 
the  effects  of  gaseous  absorption  on  the  transmitted  radiation;  however,  some 
high  power  laser  wavelengths  (for  example  3.8  pm)  are  impacted  by  gaseous 
absorption  requiring  a  measurement  of  the  absorption  coefficient.  This 
measurement  is  best  accomplished  by  using  a  calibrated  Fourier  Transform 
Spectrometer  of  at  least  2  cm'^  resolution  viewing  a  black  body  source  at  a  range 
(typically  300  m)  that  provides  acceptable  sensitivity.  The  spectrometer  fine  of 
sight  shoxild  be  within  a  crosswind  correlation  length  of  the  electro-opticed  system 
line  of  sight. 

Point  sensors  also  can  be  used  to  specify  absorbing  gas  concentrations.  The 
sensors  require  a  grid  network  having  at  least  correlation  length  spacing.  Protocol 
for  the  reliable  sensor  operation  is  well  developed  and  available  fi-om  the 
Environmental  Protection  Agency  (ref  19,  20,  21). 


2.3.4  Aerosols.  Aerosols  are  a  fimdamental  atmospheric  component  affecting 
atmospheric  transmission.  In  concentrations  exceeding  several  hundred  per  cubic 
centimeter,  aerosols  significantly  impact  electro-opticgJ  sensor-based  weapons 
systems.  Aerosol  particle  sizes  are  assumed  to  be  sufficiently  small  that,  once 
airborne,  the  particles  remain  so,  meaning  that  aerosol  particle  sizes  of  materials 
found  in  the  atmosphere  typically  are  less  than  10  pm  in  diameter.  Particles 
larger  than  10  pm  rapidly  fall  out  of  the  atmosphere  unless  atmospheric 
conditions  are  uncommon,  for  example,  dming  the  production  of  water  fogs.  In 
such  a  case,  particles  as  large  as  100  pm  in  diameter  can  remain  airborne  for 
times  much  longer  than  would  otherwise  be  possible.  Particles  that  are  too  large 
to  remain  airborne  are  considered  precipitation.  Means  of  characterizing  and 
measuring  precipitation  are  discussed  in  the  next  section. 

Two  types  of  aerosol  diameters  are  frequently  measured:  the  aerodynamic 
diameter  and  the  optical  diameter.  The  aerodynamic  diameter  is  proportional  to 
particle  physical  size  and  specific  gravity.  This  diameter  is  used  to  compute  the 
abihty  of  a  particle  to  follow  an  air  flow.  Aerodynamic  diameter  is  of  interest  for 
removal  rates  and  when  particle  drag  is  significant  as  in  wind  tunnel  simulations. 
Instruments  used  to  measure  aerodynamic  diameter  normally  express  the 
diameter  as  the  product  of  physical  diameter  and  square  root  of  particle  specific 
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gravity  (assumed  to  be  one  unless  better  information  is  available).  The  optical 
diameter  is  proportional  to  physical  size  and  optical  refractive  and  absorptive 
characteristics.  Optical  particle  coimters  that  relate  scatter  magnitude  to  particle 
diameter  express  psirticle  diameter  as  equivalent  to  that  for  a  calibration  particle 
material  (often  polyst3Tene  latex)  and  diameter  or  in  terms  of  true  diameter  when 
the  refractive  indices  of  the  particle  material  are  known.  Optical  particle  counters 
are  normally  used  for  atmospheric  aerosol  measm*ements,  because  they  can  count 
particles  at  high  rates  (thousands  per  second),  and  because  an  optical  measure¬ 
ment  is  meaningful  for  an  electro-optical  sensor.  Both  aerodynamic  and  optical 
particle-sizing  systems  assume  the  measured  particles  are  spherical,  which  is 
rarely  the  case.  Hence,  it  is  important  to  understand  that  the  measured  size  is  an 
equivalent  diameter  in  accord  with  the  response  function  of  the  instniment. 

Aerodynamic  particle  measxirement  systems  use  active  sampling.  Optical 
particle  coimters  use  active  or  passive  sampling  systems.  Active  samplers  draw  a 
sample  of  the  aerosol  into  the  measurement  system.  Passive  samplers  allow  the 
aerosol  to  drift  through  the  measurement  system  as  transported  by  atmospheric 
winds.  Active  samplers  are  commonly  found  in  field  apphcations;  however,  they 
must  be  used  with  care  to  ensure  that  the  aerosol  is  sampled  isokinetically. 
Isokinetic  sampling  is  achieved  when  the  sampling  tube  inlet  pressure  is  adjusted 
such  that  flow  streamlines  passing  around  the  samphng  tube  inlet  are  not 
perturbed.  If  the  inlet  pressure  is  too  high,  the  streamhnes  are  pulled  into  the 
inlet  effectively  increasing  the  inlet  sampling  area  and  producing  aerosol 
concentration  measimements  that  are  higher  than  the  true  value.  If  the  inlet 
pressure  is  too  low,  the  streamlines  are  diverted  away  from  the  inlet  and  the 
aerosol  concentration  measurements  are  lower  than  the  true  value. 

An  optical  particle  counter  for  atmospheric  measurements  should  be  able  to 
measure  munber  densities  as  high  as  lOVcm®  and  detect  particles  as  small  as 
0.3  pm  in  diameter  and  as  large  as  10  pm.  If  the  counter  uses  active  sampling, 
the  system  should  be  capable  of  sampling  isokinetically  by  pointing  the  sampling 
head  into  the  wind  and  adjusting  the  dynamic  pressure  for  a  range  of  wind  speeds 
between  1  and  8  m/s.  Because  there  are  no  standard  aerosols,  it  is  important  that 
aerosol  data  acquired  with  an  optical  counter  be  compared  wi^  other  independent 
measurements  to  at  least  determine  data  consistency  between  measimed  variables 
such  as  particle  size  distributions  and  mass  concentrations  obtained  with  filter 
samplers. 

The  number  of  aerosol  counters  required  for  a  line  of  sight  depends  on  the 
relative  variance  of  the  size  distribution  along  the  line  of  sight  and  the  desired 
coefficient  of  variation  (see  equation  2-4).  If  the  relative  variance  for  the  particle 
size  distribution  is  large,  an  integrated  path  measurement  utilizing  multispectral 
transmittances  from  which  the  size  distribution  is  inferred,  using  an  inversion 
algorithm  is  a  more  cost-effective  approach  than  employing  a  large  network  of 
individual  particle  sizing  systems. 
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2.3.5  Precipitation.  Precipitation  is  commonly  considered  to  include  all  forms  of 
water  that  fall  out  of  the  atmosphere.  For  precipitation  to  occur,  the  equivalent 
aerodynamic  particle  diameter  must  be  about  10  pm  or  larger.  Measiurements  of 
precipitation  include  those  for  precipitation  type,  rate  (or  mass  concentration),  and 
temperature.  These  characteristics  are  addressed  in  the  discussions  that  follow. 
Precipitation  measmements  are  particularly  important  for  sensor  systems  that 
operate  in  the  millimeter  wave  spectral  bands  where  attenuation  because  of  liquid 
water  is  particularly  strong.  When  precipitation  is  frozen,  attenuation  at 
millimeter  wave  frequencies  is  significantly  less  than  that  for  liquid  water.  Thus, 
radar  systems  are  able  to  distingtiish  between  so-called  wet  snow  (strong  return 
when  the  snow  is  a  mixture  of  ice  and  water)  and  dry  snow  (weak  return  because 
the  snow  is  virtually  all  ice). 

Millimeter  wave  extinction  and  backscatter  are  strongly  dependent  on 
precipitation  particle  shape.  Temperature,  wind  speed  versus  height,  and 
precipitation  forms  are  particularly  important  parameters  needed  to  quantify 
millimeter  wave  transmission  characteristics  through  precipitation.  Even 
raindrops  become  distorted  into  oblate  spheroids  that  have  their  axes  of  ssncnmetry 
canted  in  proportion  to  horizontal  wind  velocities.  The  raindrop  canting  angle 
affects  the  transmittance  characteristics  of  polarized  millimeter  wave  radar; 
therefore,  wind  speeds  and  wind  speed  profiles  are  also  important  pareuneters  in 
specifying  millimeter  wave  transmission  through  rain  (table  2-1). 

Schemes  for  classifying  fix>zen  precipitation  shapes  are  common  and  should 
be  used  as  a  matter  of  record.  For  example,  snow  and  sleet  types  have  been 
separated  into  the  following  category  shapes  (see  V. J.  Shaefer  and  J.A.  Day  in  A 
Field  Guide  to  the  Atmosphere.  Boston,  MA,  Houghton  Mifflin  Co.): 

1.  plates  3.  columns  5.  spatial  dendrites  7.  irregular  crystals  9.  sleet 

2.  stelleirs  4.  needles  6.  capped  columns  8.  graupel  10.  hail 


2.3.5. 1  Precipitation  Type.  Precipitation  type  falls  into  three  general 
categories:  liquid  water,  frozen  water,  and  liquid  and  frozen  water  mixtiu*es. 
Liqviid  water  preciptation  ranges  in  size  from  tens  of  micrometers  to  raindrops 
about  10  mm  in  diameter.  Above  10  mm  in  diameter  the  drops  become 
aerodynamically  unstable  and  break  up.  Raindrops  greater  than  about  240  pm  in 
diameter  begin  to  deviate  from  spherical  shapes.  Air  resistance  forces  the  drops 
into  oblate  spheroidial  shapes  that  have  their  axis  of  symmetry  tilted  by  winds 
through  which  they  fall  (ref  13).  The  size  distribution  of  raindrops  is  typically 
multimodal.  It  is  not  unusual  for  three  or  more  modes  to  exist.  Normally,  most 
raindrop  sizes  are  less  than  1  mm  in  diameter. 
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Frozen  precipitation  includes  snow,  sleet,  graupel,  and  had.  Snow  has  a 
wide  variety  of  shapes.  Sleet  differs  from  snow  in  that  sleet  does  not  have  the 
well-organized  crystalline  structiu*e  observable  in  snow.  Hail  stones  are 
spheroidal  rigid  spheres  ranging  in  size  from  mdlimeters  to  several  centimeters  in 
diameter. 

Many  forms  of  frozen  precipitation  appear  as  a  mixture  of  solid  and  liquid 
water.  Snow  may  be  "diy"  or  "wet"  depending  on  the  relative  amount  of  Hquid 
water  present.  Sleet  is  often  a  combination  of  frozen  and  hquid  water.  The 
simface  of  hail  is  often  a  thin  layer  of  liqmd  water.  The  ratio  of  frozen  to  liquid 
water  depends  on  the  precipitation  form  for  the  air  temperature  and  humidity 
distribution  through  which  the  precipitation  falls  and  the  terminal  velocity  of  the 
precipitation. 

Instruments  that  measure  precipitation  particle  size  and  shape  must  use 
methods  that  can  accommodate  nonspherical  particles  and  particles  that  are 
significantly  larger  than  aerosol  particles.  For  example,  snow  comes  in  a  wide 
range  of  shapes  as  does  sleet.  Thus,  instruments  that  record  images  of  the 
precipitation  such  as  photographic  or  holography  cameras  are  often  used  for 
research  types  of  measurements.  Indirect  means  of  inferring  precipitation  particle 
size  and  shapes  include  the  use  of  polarized  radars  (ref  13). 

It  is  common  practice  to  measiire  frozen  precipitation  in  terms  of  equivalent 
liquid  water  content.  A  device  for  these  types  of  measurements  has  been 
developed  by  the  Canadian  Defense  Research  Establishment,  Val  Cartier,  and  the 
U.S.  Army  Corp  of  Engineers  Cold  Regions  Research  and  Engineering  Laboratory 
(ref  22).  Number  densities  of  precipitation  particles  are  much  lower  than  aerosols, 
but  because  of  their  increased  sizes,  they  typically  have  much  higher  mass 
concentrations . 


2.3.5.2  Precipitation  Rate.  Precipitation  rate  is  a  commonly  used  integral 
measure  of  mass  concentration  per  unit  time  (particle  flux)  dehvered  by  the 
precipitation  source.  The  precipitation  rate  for  any  particle  form  can  be  expressed 
in  the  form  of  an  equivalent  rain  rate  (ref  4).  The  rain  rate  in  mm/hr  is 

R=4.iT^'10'^‘  j  v(a)a^n{a)da  (2-5) 

0 

where  v(a)  is  the  terminal  velocity  in  m/s,  a  is  the  drop  radius  in  millimeters,  and 
is  the  maximum  radius  in  the  number  density  at  size  a  per  size  increment, 
n(a).  For  precipitation  that  is  not  liquid  drops,  equation  2-5  shows  the 
precipitation  rate  is  affected  by  the  mass  distribution  (a®n(a))  of  the  precipitation 
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and  the  particle  terminal  velocity  (a  strong  function  of  particle  shape).  It  is 
common  practice  to  relate  radar  attenuation  and  cross  section  to  rain  rate  in  the 
form  expressed  by  equation  2-5.  The  attenuation  is  approximately 


A  (dbikm)  =  kJ?^ 


(2-6) 


The  rain  rate  or  its  equivalent  correlates  uniquely  with  particular  radar 
frequencies  and  precipitation  types.  The  constants  k  and  y  are  unique  for  each 
radar  frequency.  Equations  2-5  and  2-6  illustrate  the  need  for  accurate 
precipitation  measmements  down  the  propagation  line  of  sight  or  from  a  properly 
spaced  network  of  sensors  that  can  detect  the  type  of  precipitation  as  well  as  its 
rate. 


2.3.5.3  Precipitation  Temperature.  Because  the  complex  dielectric  constant  of 
water  at  millimeter  wave  frequencies  is  a  function  of  temperature,  it  is  important 
to  determine  the  precipitation  temperature  (ref  23).  The  complex  dielectric 
constant  is  a  major  parameter  that  determines  millimeter  wave  attenuation 
propagation  characteristics.  Liquid  water  is  strongly  absorbing  at  milUmeter  wave 
frequencies;  ice  is  nearly  transparent.  Changes  of  fractions  of  a  degree  near  0  °C 
can  affect  the  attenuation  characteristics  of  precipitation  by  orders  of  magnitude. 
This  is  the  reason  for  the  so-called  'hright-band"  radar  effect  for  wet  snow  which 
has  a  significant  liquid  water  content.  The  precipitation  temperature  must  be  the 
true  thermodynamic  temperature  rather  than  an  equivalent  brightness 
temperatxire  such  as  might  be  produced  by  a  FLIR  measurement. 


2.3.6  Terrain  Signatures.  Terrain  signatures  £ire  one  of  the  major  backgromds 
against  which  electro-optical  sensors  must  detect  targets.  Atmospheric  conditions 
affect  the  terrain  signature  in  visual,  infrared,  and  millimeter  wave  bands.  Dew 
and  frost,  for  example,  provide  a  much  brighter  background  against  which  to 
detect  targets  than  dry  vegetation.  Moist  soil  has  a  different  infrared  emissivity 
than  dry  soil.  Further,  the  amount  of  water  vapor  and  other  absorbing  gases  in 
the  atmosphere  can  radically  affect  the  observed  terrain  spectral  signature  at  long 
rsmges.  Although  terrain  signatures  are  not  explicitly  related  to  atmospheric 
characteristics,  the  interaction  of  terrain  signatures  with  atmospheric 
characteristics  affects  the  performance  of  electro-optical  sensors.  Thus, 
atmospheric  effects  on  terrain  signatures  are  briefly  discussed  in  this  section,  with 
the  view  that  evaluation  of  electro-optical  sensor  performance  in  the  atmosphere 
can  require  measurement  of  these  parameters  as  supporting  data. 
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2.3.6. 1  Dew  and  Frost.  Dew  and  frost  increase  the  reflectivity  or  emissivity  of 
backgro\md  terrain.  Dew  is  more  likely  to  produce  nearly  specular  reflections  of 
backgroimd  radiation,  whereas  frost  has  a  higher  magnitude  diffuse  reflection 
component  in  the  visual  band.  In  the  thermal  infrared  bands,  dew  in  droplet  form 
reflects  sky  radiation  which  appears  much  cooler  than  normal  terrain  signatures. 
Frost  specular  reflection  in  the  thermal  infrared  band  will  have  a  similar  effect. 

In  the  millimeter  wave  bands,  dew  will  be  highly  reflective  because  of  the  liqxiid 
water  component,  whereas  frost  reflectivity  will  depend  mainly  on  the  sTnall 
fraction  of  liquid  water  present  in  the  frost.  The  frozen  component  contributes 
relatively  little  signal  return. 

Meterological  parameters  used  to  characterize  dew  and  frost  include  the 
temperature  and  relative  humidity  conditions  under  which  they  are  formed  and 
the  temperatiire  of  backgroimd  terrain  on  which  they  condense.  For  electro- 
optical  sensor  testing,  it  is  important  that  the  backgroimd  visual  luminance  and 
infrared  radiance  magnitudes  be  measured  in  the  direction  of  the  sensor  as  well  as 
the  target  to  background  contrast.  At  times  when  dew  and  frost  are  significant 
factors  in  scene  characterization,  background  lighting  and  the  dew  and  frost  level 
changes  rapidly.  Consequently,  it  is  important  that  the  characterization  data  be 
sampled  at  rates  as  high  as  possible  with  10  point  running  averages  used  to 
smooth  the  data  and  that  averages  of  the  data  be  made  over  times  in  which  the 
mean  value  of  the  measured  parameter  is  stationary. 


2.3.6.2  Target^ackground  Emissivities.  Emissivity  is  defined  as  the  ratio  of 
spectral  radiance  emitted  by  an  object  to  that  of  a  perfect  black  body  at  the  same 
temperature.  Most  previous  field  tests  and  analyses  have  assumed  that  the 
emissivity  of  backgrounds  and  targets  were  identical,  had  a  value  near  that  of  a 
blackbody  (0.98  -  1.0)  and  were  independent  of  wavelength  (a  so-called  graybody). 
These  assumptions  allow  radiance  differences  between  targets  and  backgrounds 
observed  with  3-5  and  8-14  pm  band  FLIRs  to  be  expressed  in  terms  of  apparent 
temperature  differences  between  targets  and  backgrounds,  because  the 
radiometric  difference  is  linearly  proportional  to  thermodynamic  temperature 
difference.  As  a  result,  FLIR  performance  and  response  specifications  are  often 
given  in  terms  such  as  "minimum  resolvable  temperature  difference"  (MRTD). 

This  approach  has  resulted  in  much  confusion  and  test  data  that  are  highly 
limited  in  the  scope  of  their  apphcability  to  other  scenarios.  For  example,  the 
MRTD  is  a  function  of  the  absolute  magnitude  of  the  source  radiance  for  which  it 
was  developed.  Different  calibration  source  magnitudes  yield  different  MRTD 
response  values.  It  is  possible  (and  may  often  occur)  that  a  radiometric  difference 
can  be  observed  between  target  and  background  when  both  objects  have  identical 
thermodynamic  temperatures,  because  spectral  emissivities  between  target  and 
background  are  not  equal.  The  assumption  that  thermodynamic  temperature 
difference  between  target  and  background  is  nearly  the  same  or  linearly 
proportional  to  the  ’'brightness  temperature"  or  radiometric  temperature  difference 
leads  to  major  differences  between  predictions  and  observations.  A  rule  of  thumb 
is  that  a  1  percent  change  in  emissivity  corresponds  to  a  half  degree  change  in 
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brightness  temperature  difference  (ref  24,  25).  Thus,  a  target  moved  to  a  slightly 
diflferei  background  from  those  of  the  test  conditions,  but  operating  under 
identic^  leteorological  and  thermodynamic  conditions,  could  have  a  significantly 
different  radiometric  contrast  that  affects  the  performance  envelope  of  the  sensor 
under  test.  If  emissivity  varies  with  wavelength,  sensor  radiometric  response  is 
the  integral  product  of  emissivity  and  sensor  spectral  response.  This  means 
extrapolation  of  sensor  performance  among  sensors  operating  in  the  same  spectral 
bemd,  but  with  different  sensor  spectral  responses,  is  nonlinear.  Sensor 
performance  extrapolation  in  this  case  can  be  estimated  accurately  only  with  a 
response  inversion  algorithm. 

Similar  considerations  apply  to  tests  where  the  sensor  backgroimd  is  sky  or 
sea.  The  magnitude  of  background  infrared  radiation  for  sky  backgromids  is 
typically  less  than  that  for  terrain  backgroimds.  A  sky  backgroimd  with  clouds 
can  fluctuate  strongly  as  a  function  of  sim  position  relative  to  sensor  line  of  sight 
and  terrain  reflectivity.  Both  solar  and  terrain  reflectivity  contribute  to  cloud 
illumination.  To  first  order,  terrain  reflectivity  is  1  -  spectral  emissivity.  Thus, 
cloud  radiation  indirectly  depends  on  emissivity  from  the  terrain  supplying 
radiation  to  the  ground  illuminated  cloud.  Over  water  surfaces,  the  surface 
emissivity  (1  -  spectral  reflectivity)  and  reflectivity  depend  on  the  angle  of 
incidence  of  the  incident  radiation  on  wave  surfaces.  Surface  roughness,  or  sea 
state,  which  defines  the  distribution  of  wave  reflecting  angles  plays  a  major  role  in 
the  thermal  contrast  background  (ref  26).  At  the  land  sea  interface  where  terrain 
and  water  wave  emissivity  and  reflectivity  must  be  considered  simultaneously, 
detailed  spectral  measurements,  and  specification  of  water  and  terrain  conditions 
are  reqiiired.  The  signature  data  base  for  the  land-sea  interface  is  limited  and  is 
imdergoing  major  development. 

To  ensure  that  meteorological  and  target  signature  data  for  electro-optical 
systems  operating  in  the  infrared  bands  are  consistent  between  measurements 
over  similar  types  of  background,  it  is  important  to  determine  the  spectral 
emissivity  of  the  target  and  target  background.  There  is  no  standard  method  for 
the  measurement  of  emissivity.  A  recommended  method  for  determining 
emissivity  is  to  measure  the  bidirectional  reflectance  distribution  function  (BRDF). 
The  emissivity  is  taken  to  be  (1-BRDF).  The  BRDF  is  the  variation  of  reflected 
radiance  (power  projected  per  unit  projected  area  per  unit  solid  angle)  per  unit 
variation  of  incident  irradiance  for  given  polarization  states  of  source  and  receiver. 
Spectral  resolution  for  emissivity  measurements  should  be  at  least  4cm'^. 


2.3.7  Humidity  and  Temperature  Structure  Constants.  Most  atmospheric 
effects  on  electro-optical  sensor  performance  depend  on  differences  in  optical  paths 
rather  than  absolute  values  of  optical  paths.  The  notable  exceptions  are  radars 
where  absolute  path  lengths  are  critical.  Spatial  statistics  of  random  atmospheric 
variable  differences  for  index  of  refraction,  humidity,  or  temperature  are  often 
given  in  terms  of  "structure  functions"  rather  than  autocovariance  or 
autocorrelation  functions.  Structure  fimctions  are  typically  defined  as  the 
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ensemble  average  of  the  square  of  the  difference  between  the  variable  measured  at 
two  spatial  locations.  If  the  random  process  producing  the  parameter  is  isotropic, 
the  structure  function  is  a  function  only  of  the  absolute  distance  between  the 
measurement  points.  In  the  atmosphere,  solar  heating  produces  kinetic  energy 
over  scale  sizes  that  range  from  meters  to  global  sizes.  Near  the  earth’s  surface, 
kinetic  energy  leaves  the  air  by  frictional  generation  of  heat  over  scales  that  range 
from  a  few  millimeters  to  a  few  meters.  This  phenomenon  is  called  the  "inertial 
sub  range."  Over  this  range,  the  structure  functions  are  proportional  to  the 
separation  distance  raised  to  the  2/3  power.  The  constant  of  proportionality  is  the 
structure  constant.  Structxu*e  constants  are  functions  of  height  above  ground, 
wavelength,  and  transmission  pathlength.  For  homogeneous  turbiilence,  structm-e 
constants  are  proportional  to  correlation  lengths  for  index  of  refraction,  relative 
humidity,  and  temperature  (ref  27,  28,  29). 

The  index  of  refraction  structure  constants  are  used  to  compute  such  factors 
as  laser  beam  spread  through  a  turbulent  atmosphere  as  a  function  of  wavelength 
and  path  length.  Refraction  because  of  turbulence  primarily  affects  sensors  in  the 
visual  and  infrared  wavelength  bands.  It  has  relatively  little  impact  on  millimeter 
wave  and  microwave  frequencies;  however,  the  millimeter  wave  bands  are  affected 
by  water  vapor  absorption,  which  is  a  function  of  relative  humidity  and 
temperature  fluctuations  caused  by  atmospheric  turbulence.  Thus,  the  primary 
structure  constants  of  interest  for  millimeter  wave  propagation  are  those  for 
temperature  and  relative  humidity.  The  index  of  refraction  structure  constants 
can  be  measured  with  path  integrating  instruments  such  as  those  developed  by 
NOAA  (ref  27,  28).  These  instruments  are  preferred  over  techniques  using  point 
measurements  obtained  by,  for  example,  measming  the  temperatiire  structure 
constant  with  sets  of  thermometers,  then  computing  the  index  of  refraction 
structure  constant.  The  integrated  path  instruments  are  preferred  because  of  the 
likely  variation  of  the  structure  constants  along  the  measurement  path.  The 
structure  constants  represent  integrated  path  conditions  and  should  be  measured 
accordingly.  Similar  considerations  apply  for  the  effects  of  turbulence  on 
millimeter  wave  propagation;  however,  oximeter  wave  equivalent  scintillometers 
are  not  common.  Most  structure  constant  measurements  for  temperature  and 
relative  hmnidity  are  made  with  networks  of  point  sensors,  and  values  of  the  cross 
correlations  between  temperature  and  absolute  humidity  are  assumed  to  provide 
the  necessary  structure  constants  for  evaluating  the  effects  of  turbulence  on 
millimeter  wave  propagation.  Unfortimately,  these  data  may  not  agree  well  with 
similarity  theory  predictions  (ref  29,  30).  The  Monin-Obukhov  similarity  theory  in 
fluid  mechanics  hypothesizes  that  nondimensionalized  properties  of  a  flow  are 
universal  functions  of  a  stability  parameter.  The  theory  is  reasonably  accimate  for 
some  atmospheric  variables,  but  not  for  potential  refractivity  (ref  30).  The 
assumption  that  refraction  effects  can  be  treated  with  similarity  theory  by 
assuming  temperatiu-e  and  humidity  veiriations  are  always  coherent  is  commonly 
used,  because  some  models  can  be  greatly  simplified  (ref  31,  32).  In  some 
applications,  the  assumption  of  a  temperature-humidity  coherence  value  of  1.0 
leads  to  the  unrealistic  result  that  the  structure  constant  for  refractive  index 
approaches  0  for  millimeter  wave  propagation  (ref  29,  32). 
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2.3.8  Sea  State.  '  sa  state  specification  is  necessary  to  estimate  sea  target 
background.  The  World  Meteorological  Organization  sea  state  scale  should  be 
employed  to  define  sea  state  ir  commonly  accepted  terms.  The  specification  of  sea 
state  is  particular  /  important  for  evaluation  of  imaging  systems  in  the  visible  and 
infi’ared  bands.  Depending  on  sea  state,  radiation  speciilarly  or  difiusely  reflected 
or  emitted  firom  the  surface  can  be  polarized.  Computation  of  reflection  or 
emission  fi'om  wind-driven  water  waves  assumes  that  the  surface  consists  of  many 
plane  facets  having  various  slopes  and  large  dimensions  relative  to  the  wavelength 
of  the  radiation.  Iherefore,  it  is  necessary  to  define  the  size,  tilt,  and  orientation 
of  the  wave  facets  relative  to  the  wind  vector  and  to  measure  the  wind  vector  to 
characterize  the  sea  state.  If  it  is  not  possible  to  directly  measure  wave  facet  size 
and  tilt  and  orientation,  the  measurement  of  the  wind  vector  can  be  used  with  the 
probability  distribution  developed  by  Cox  and  Munk  to  predict  facet  tilt  and 
orientation  angles  (ref  26).  Sensor  performance  can  be  radically  affected  by  the 
polarization  of  the  background  radiation.  It  is  important  that  ^e  polarization 
properties  of  the  radiation  be  determined  if  the  electro-optical  sensor  xmder  test  is 
polarization  sensitive. 


2.3.9  Background  Radiation.  One  of  the  most  difficult  tasks  in  evaluating 
electro-optical  sensor  performance  in  the  atmosphere  is  the  measurement  of  the 
backgroimd  radiation  budget.  Radiation  sources  include  the  sun,  moon,  stars, 
reflection,  and  emission  fi'om  terrain,  clouds,  and  atmospheric  scatter  from  all 
sources.  Each  source  has  spectral  structure  and  a  magnitude  that  can  vary  with 
time  of  day  and  location.  If  the  spectral  response  of  the  electro-optical  sensor 
tmder  test  is  not  constant  over  the  spectral  operating  band,  it  is  important  to 
spectroscopically  measure  the  spectral  content  of  the  backgroimd  radiation.  If  the 
sensor  response  is  spectrally  constant,  then  it  is  proper  to  measure  only  the 
integral  value  of  the  backgroimd  radiation  with  a  calibrated  broad  band  sensor. 
Direct  and  difiuse  radiation  in  the  visual  band  (0.4-0.7  pm)  are  typically  measured 
with  a  pyrheliometer  and  pyranometer.  Diffuse  infrared  irradiance  in  the  3-20  pm 
band  is  measured  with  a  pyrgeometer.  A  radiometer  that  uses  a  circ\alarly 
variable  filter  is  typically  used  to  measure  spectral  radiance  and  irradiance, 
especially  in  the  thermal  infi*ared  bands  where  spectral  resolution  is  low.  A 
Fourier  transform  spectrometer  can  be  used  to  provide  high  resolution  spectral 
measurements  in  the  2-14  pm  band.  The  characteristics  of  the  various  sources  of 
atmospheric  radiation  are  discussed  next. 


2.3.9. 1  Global  Irradiance.  Global  irradiance  is  the  total  radiant  flux  density 
incident  on  the  Earth’s  surface  from  the  totality  of  the  upward  hemisphere.  It 
includes  radiation  contributions  fi*om  the  sxm  and  sky.  It  is  also  referred  to  as 
global  radiation,  insolation,  or  solar  radiation. 
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2.3.9.2  Diffa.se  Global  Radiation.  Global  irradiance  is  often  considered  to  be 
formed  of  direct  radiation  (from  the  sxm  only)  and  diffuse  radiation  (from  the  sky 
only).  The  diffuse  global  radiation  is  the  integral  of  the  sIq^  radiance,  R^^y,  over 
the  entire  upward  hemisphere  excluding  the  sun  (ref  4). 


2k 

(2-7) 


6  is  the  solar  zenith  £ingle  measured  from  the  vertical  and  dG  is  the  differential 
increment  of  sky  solid  angle  centered  about  0  that  contributes  to  the  diffuse  global 
radiation  observed  at  a  point  on  the  siirface.  The  global  irradiance  is  found  by 
adding  the  solar  beam  irradiance  to  the  diffuse  sky  component. 


^global  ~  *  ^mm 
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Egu„  is  the  solar  beam  irradiance  and  is  the  solar  zenith  angle. 


2.3.9.3  Directional  Sky  Radiation.  Isopleths  (constant  contours)  of  diffuse  sky 
irradiance  are  spatially  variable  and  change  with  time  as  the  sim  changes  position 
in  the  sky.  Near  the  sun,  the  isopleths  are  circular.  As  the  angle  from  the  sim 
increases,  the  isopleth  drcular  symmetry  is  quickly  changed  to  paths  that 
encompass  the  entire  upward  hemisphere.  For  air-to-groimd  or  ground-to-air 
electro-optical  sensor  applications,  it  is  important  to  specify  the  sky  or  solar  beam 
radiation  within  the  sensor’s  field  of  view.  This  radiation  level  determines  in  part 
the  sensor  signal  to  noise  ratio.  By  determining  the  sky  radiation  isopleths  at 
which  the  sensor  is  pointed,  sensor  performance  can  be  decided  over  the  range  of 
zenith  and  azimuth  angles  encompassing  the  isopleths  that  are  less  than  or  equal 
in  magnitude  to  the  isopleths.  A  spectral  radiometer  moimted  on  a  tracking 
theodolite  is  typically  used  to  measure  sky  isopleths. 


2.3.9.4  Sky-Ground  Luminance  Ratio.  Luminance  is  radiance  weighted  by  the 
wavelength  according  to  the  spectral  response  of  the  human  eye.  The  sky-groxmd 
luminance  ratio  (often  called  sky-groimd  ratio)  is  the  ratio  of  horizon  sky 
luminance  iromediately  above  the  target  to  the  groimd  level  Imninance 
surrounding  the  target.  The  luminances  are  measured  with  a  telephotometer 
using  a  photopic  filter  to  ensure  proper  spectral  response  for  the  measurement. 
Figure  2-8  illustrates  the  potential  sources  of  variation  of  the  sky-groimd 
luminance  ratio  in  a  single  scene.  It  is  important  that  the  lines  of  sight  for  this 


2-48 


measurement  are  commensurate  with  the  electro-optical  sensor  view  of  the  target. 
Not  only  does  ground  level  Imninance  vary  greatly,  but  horizon  sky  Imninance  is  a 
strong  fimction  of  sim  position.  It  should  be  recalled  that  a  major  application  of 
the  sky-ground  luminance  ratio  is  computation  of  visual  range,  as  discussed  in 
subparagraph  2.3.1. 


2.3.9.5  Down  Welling  Spectral  Direct  Radiation.  The  down  welling  spectral 
direct  radiation  is  spectrally  resolved  direct  solar  radiation.  It  is  the  same 
measurement  described  in  subparagraph  2.3.9. 1,  except  that  the  input  radiation  is 
spectrally  resolved.  Spectrally  resolved  data  are  required  to  compare  different 
sensors  operating  in  the  same  spectral  band  and  to  model  scene  images  from  first 
principles.  Spectrometer  resolution  reqmred  for  these  measurements  varies  with 
the  application  for  which  the  data  are  intended.  The  resolution  can  vary  for  the 
infrared  bands  from  4  cm'^,  for  applications  where  aerosol  scatter  and  precipitation 
have  significant  impact  on  the  radiation  reaching  the  surface  from  the  sun,  to 
16  cm'^  or  larger,  when  band  averages  are  the  primaiy  concern  for  sensors  such  as 
FLIRs.  For  visual  to  near  infrared  bands,  spectral  resolution  of  the  order  100 
Angstroms  is  sufficient.  The  magnitude  and  spectral  content  of  this  radiation  is 
highly  variable  and  dynamic,  because  the  solar  radiation  moves  through  an  air 
mass  that  has  a  wide  diiumal  range.  The  sampling  frequency  of  the  measurement 
spectrometer  must  be  at  a  rate  sufficient  to  ensime  that  co-added  measured 
spectra  are  obtained  through  essentially  the  same  air  mass.  It  is  normal  practice 
to  improve  measured  spectrum  signal-to-noise  ratio  by  co-adding  repeated  spectral 
measurements.  If  N  spectra  are  co-added,  the  signal-to-noise  ratio  will  increase  by 

Vn. 


2.3.9.6  Down  Welling  Spectral  Diffuse  Radiation.  Down  welling  spectral 
diffiise  radiation  is  spectrally  resolved  sky  radiation  incident  at  the  surface.  It  is 
the  same  measurement  described  in  subparagraph  2.3.9.2,  except  that  the  input 
radiation  is  spectrally  resolved.  This  measmement  is  made  for  the  same  reasons 
as  those  for  the  direct  radiation.  The  same  spectrometers,  spectral  resolution,  and 
sampling  rates  are  used  for  these  measurements  as  for  those  of  the  direct 
measmements. 


2.3.9.7  Directional  Spectral  Sky  Radiation.  Directional  spectral  sky  radiation 
is  represented  by  isopleths  of  the  type  described  in  subparagraph  2.3.9.3,  except 
that  the  isopleth  is  spectrally  resolved  for  the  spectral  band  considered. 
Alternatively,  narrow  band  filters  can  be  used  to  generate  narrow  band  isopleths 
rather  than  those  for  a  broad  band.  Narrow  band  isopleths  can  be  different  from 
those  of  the  broad  band  which  are  much  more  dependent  on  measurement 
radiometer  characteristics.  Broad  band  isopleths  are  weighted  by  the  spectral 
response  of  the  radiometer  used  to  make  the  observation,  the  spectral  distribution 
of  energy  within  the  band,  and  the  spectral  scattering  characteristics  for  the 
atmosphere. 
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2.3.10  Spectral  Transmittance.  Spectral  transmittance  is  a  fundamental 
radiometric  measurement  for  narrow  or  broad  band  electro-optical  sensor  systems. 
A  transmittance  measurement  is  said  to  be  narrow  hand  if  P(X),  the  atmospheric 
extinction  as  a  function  of  wavelength,  is  constant  in  the  interval  A,„  1^,  and  the 
atmospheric  transmittance  can  be  brought  outside  the  integral  representing  band 
averaged  transmittance  (see  equation  2-9).  The  measurement  is  broad  band  if  the 
atmospheric  transmission  containing  P(A.)  must  be  kept  tmder  the  integral  because 
of  significemt  variations  in  transmittance  between  Narrow  band 

transmittance  is  typically  measured  using  a  laser  for  the  source  or  a  narrow  band 
filter  to  reject  background  illumination  thereby  increasing  the  dynamic  range  of 
the  measurement.  Narrow  band  measm*ements  are  normally  used  to  quantify 
performance  of  laser  systems.  Broad  band  measiuements  are  normally  made 
using  high  temperature  (1000-1500  °C)  blackbody  sources  with  outputs  collimated 
to  a  few  milliradians  of  divergence.  A  broad  band  receiver  is  either  a  single 
passband  system  or  a  spectrometer  that  performs  a  series  of  narrow  band 
measin-ements  across  the  band.  Broad  band  electro-optical  sensors  such  as  FLIRs 
operate  in  a  single  passband.  To  acciirately  interpret  electro-optical  system 
performance,  a  spectroscopic  measxn-ement  is  required  of  transmittance  across  the 
passband  of  the  sensor.  Fourier  transform  spectrometers  (FTS)  are  especially 
appropriate  for  this  task,  because  FTS  systems  produce  high  resolution,  and  have 
the  highest  throughput  and  fastest  spectral  acqioistion  for  any  spectrometer 
operating  in  the  2-14  pm  band.  A  circularly  variable  filter  (CVF)  radiometer, 
while  having  much  lower  resolution  capabilities  than  an  FTS,  can  be  configured  to 
measure  bands  in  the  visible  through  14  pm  band  at  1-2  Hz  rates. 

A  transmittance  measurement  is  made  with  a  known  radiation  source  and  a 
radiometer  viewing  the  som*ce.  The  pmpose  of  spectral  transmittance  data  is  to 
determine  the  attenuation  as  a  function  of  wavelength.  Attenuation,  as  a  function 
of  wavelength,  is  used  to  determine  target  probabifity  of  detection.  To  obtain 
meaningful  results,  the  transmittance  source  must  either  have  the  same  spectral 
content  as  the  target,  or  must  be  calibrated  such  that  equivalent  transmittances 
for  low  temperature  target  radiation  and  a  high  temperature  transmissometer 
source  can  be  computed.  For  example,  transmissometer  sources  are  often 
blackbodies  that  operate  at  temperatures  between  1000-1500  °C  (1273-1773  K). 
This  somce  transmittance  is  applied  to  sensors  operating  against  tanlr  targets 
that  are  less  than  30  °C.  Even  if  the  tank  is  a  perfect  blackbody  (which  it  is  not) 
like  the  radiometer  soin-ce,  the  difference  in  temperatures  means  that  the 
transmissometer  source  and  tank  spectral  irradiance  characteristics  are  widely 
different.  Transmittance  measured  with  a  radiometer  observing  a  high 
temperature  source  can  be  much  different  than  that  for  a  FLLR  observing  the  low 
temperature  tank  even  though  the  radiometer  and  FXJR  are  measuring  and 
observing  commensurate  fines  of  sight  and  are  operating  in  the  same  spectral 
band.  This  effect  is  illustrated  by  figures  2-9  and  2-10.  The  3-5  pm  blackbody 
spectral  distributions  for  a  1500  “C  (1773  K)  transmissometer  source  and  27  °C 
(300  K)  target  are  shown  in  figures  2-9.  Figure  2-9  shows  the  hot  radiometer 
som-ce  has  a  different  spectral  structure  than  the  cool  target.  The  spectral 
radiance  increases  nearly  two  orders  of  magnitude  between  3  and  5  pm.  For  the 
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al  iiradiance  distributions  for  a  27  °C  (300  K)  blackbody  target 
K)  blackbody  radiometric  source. 


same  spectral  band,  the  transmissometer  source  spectral  radiance  decreases  by 
about  50  percent  over  the  same  band.  Figure  2-10  shows  soiirce  and  target 
transmittance  through  a  water  fog  as  a  function  of  concentration  length  expressed 
as  the  product  of  the  fog  Sauter  mean  particle  diameter,  D32  in  micrometers  and 
the  water  density,  p^,  and  ratio,  7JV  of  transmission  distance  for  the  radiometer 
and  teirget  sources,  Z,  relative  to  visual  range,  V,  Figure  2-10  clearly  shows  the 
major  differences  in  transmittance  between  the  two  sources.  These  results  show, 
for  example,  that  if  the  high  temperature  transmissometer  source  yields  a 
transmittance  of  1  percent,  the  actual  target  transmittance  is  about  5  percent.  If 
the  probability  of  detection  was  50  percent  at  1  percent  transmittance,  the  target 
is  more  likely  to  be  seen  than  is  predicted  by  the  high  temperatime  soimce 
transmissometer  measurement.  When  a  transmittance  measurement  is  made  to 
support  electro-optical  sensor  evaluation  in  the  atmosphere,  it  is  important  to 
express  the  measured  transmittance  in  terms  of  the  sensor-to-target  transmittance 
that  actually  occurs.  The  transformation  is  possible  provided  the  spectral  content 
of  the  transmissometer  source  and  target  and  spectral  response  of  the 
transmissometer  radiometer  and  sensor  are  known  in  addition  to  the  directly 
measiu*ed  transmittance  (ref  33). 

There  are  two  broad  categories  of  transmittance  measurement  made  to 
support  electro-optical  sensor  testing  in  the  atmosphere:  absolute  transmittance 
and  relative  transmittance.  In  each  of  these  categories  either  a  narrow  band  or 
broad  band  transmittance  measurement  is  made.  To  clarify  the  significance  of 
these  classifications  consider  the  equation  representing  the  transmittance  process. 
The  transmittance,  x,  is 


I,  /'=  e^-p(A)Z)*a)di 

t  =  -Jh - 

1. 


(2-9) 


P(\)  is  the  atmospheric  extinction,  d>(X,)  is  the  source  and  radiometer  spectral 
response,  A,;,  Xg  are  the  limits  of  the  spectral  band  over  which  the  transmittance  is 
measured,  is  the  integrated  source  irradiance  magnitude  at  the  aperture  of  the 
radiometer  and  is  the  integrated  source  radiance  magnitude  for  zero  pathlength. 
Z  is  the  distance  between  the  transmitter  and  receiver. 
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Figure  2-10.  3-5  transmittance  to  a  27  ®C  (300  K)  blackbody  target  or  a  1500  °C  (1773  K)  radiometric 
source  at  range  Z  through  a  water  fog  having  a  D32(]im)  Sauter  mean  droplet  diameter 
and  Koschmeider  visual  range,  V. 


Absolute  transmittance  is  measured  by  determining  absolute  values  for  ^ 
and  I„.  If  the  source  is  perfectly  collimated,  Ij  =  I^.  However,  normal  optical 
divergence  spreads  the  transmitted  radiation  beam,  and  if  the  spatial  distribution 
of  the  beam  is  not  \miform,  can  be  significantly  different  than  at  the  zero  path 
length  measurement  at  the  source.  Furthermore,  refi'active  turbulence,  depending 
on  the  magnitude  of  the  refractive  index  structure  constant,  C/,  and  wavelength 
will  spread  the  beam  over  an  area  larger  than  normal  optical  ^vergence.  Thus, 
an  absolute  transmittance  measurement  is  extremely  difficult  and  rarely 
attempted,  except  with  highly  collimated  sources  that  produce  spatially  imiform 
beams  transmitted  to  large-aperture  radiometers  of  sufficient  size  to  fully  collect 
radiances  that  are  spread  and  modulated  spatially  and  temporally  by  refractive 
tinrbulence.  Absolute  transmittance  measurements  are  required  to  verify  that 
models  such  as  MODTRAN  or  FASCODE  define  the  performance  envelope  of  a 
sensor  or  define  the  aerosol  or  gaseous  content  of  the  atmosphere  (ref  34,  35). 

Relative  transmittance  is  much  easier  to  measm*e  than  absolute 
transmittance.  Relative  transmittance  is  obtained  by  normalizing  the  measured 
radiance  fi-om  the  sovurce  by  the  radiance  measured  for  a  particular  path 
situtation,  rather  than  for  the  zero  path  source  radiance.  For  example,  relative 
transmittance  is  used  to  quantify  the  attenuation  resulting  fi*om  smokes/ 
obscurants  in  a  sensor  line  of  sight  relative  to  that  of  "clear  air."  Thus,  the 
transmittance  with  smokes/obscurants  in  the  sensor  line  of  sight  is  measured 
relative  to  the  transmittance  when  none  are  present.  This  measurement  yields  a 
measime  of  the  concentration  length  (the  product  of  mean  concentration  and 
transmission  path  length)  and  extinction  properties  of  the  smokes/obscurants  in 
the  sensor  line  of  sight.  Relative  transmittance  measurements  define  and  detect 
changes  to  a  reference  atmosphere. 


2.3.11  Index  Of  Refraction  Structure  Constant  The  index  of  refi-action 
structure  constant  (see  subparagraph  2.3.7  for  a  definition  of  structure  constant) 
can  be  computed  from  the  correlation  of  integrated  path  effects  on  parallel 
transmitted  beams  (the  principle  behind  the  optical  scintillometer  (ref  27,  28)), 
from  the  correlation  of  vertically  separated  temperatiure  sensors,  or  from  the 
correlation  of  vertically  separated  relative  humidity  sensors.  Of  the  three,  the 
integrated  path  optical  scintillometer  produces  the  most  reliable  measurements 
and  should  be  used.  Recently,  a  device  designed  to  measure  the  index  of 
refraction  structure  constant  with  a  single  beam  and  a  holographic  transmission 
grating  has  been  introduced  to  the  commercial  market  and  appears  to  offer  even 
higher  quality  measurements  than  the  dual  beam  scintillometer.  This  device  now 
is  undergoing  extensive  evaluation  by  the  Army. 

2.3.12  Surface  and  Aloft  Meteorological  Situation.  Test  and  evaluation  of 
electro-optical  weapons  systems  requires  careful  specification  of  the  atmospheric 
envelope  for  operations.  Variables  such  as  the  mixing  layer  height  are  key  to 
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determining  atmospheric  transport  and  diffusion,  forecasting  precipitation  and 
turbulence,  estimating  likely  aerosol  content,  and  defining  radiative  transfer 
characteristics  pertinent  to  sensor  operation. 


2.3.12.1  Surface  Meteorological  Measurements.  Surface  meteorological 
characteristics  are  normally  determined  by  networks  of  meteorological  sensors. 

For  example,  the  Army  has  developed  a  portable  network  system  that  is  one  of  the 
most  advanced  and  useful  for  surface  meteorological  measurements.  The  Surface 
Atmospheric  Measuring  System  (SAMS)  consists  of  solar  powered  remote  field 
data  collection  platforms  (DCP)  and  a  centrally  located  acquisition  control  unit 
(ACU).  The  DCPs  consist  of  a  10-meter  mast  on  which  several  meteorological 
sensors  are  mounted  including  wind  speed,  wind  direction,  temperature,  pressime, 
relative  humidity,  solar  radiation,  precipitation,  and  soil  moistiu-e.  Other  sensors 
can  be  attached  to  the  system  to  measm*e  visibility,  cloud  height,  and  inversion. 
The  system  can  log  and  store  any  analog  or  pulse  signal  fi*om  other  measiu’ement 
devices  such  as  those  designed  to  measure  atmospheric  gases  or  particulates.  As 
the  sensors  are  measuring  the  atmospheric  variables,  the  data  are  processed  and 
stored  in  a  data  logger  and  magnetic  tape.  Periodically  (15  to  30  minutes),  each 
station  is  interrogated  through  a  radio  link  by  the  acquisition  control  unit  and  the 
data  set  transferred  to  the  ACU  computer  for  storage  and  archiving.  Reports  are 
generated  for  use  as  required.  These  reports  include,  but  are  not  limited  to, 
current  data  fi*om  each  station  and  the  last  24-hour  data  from  individual  stations. 

When  a  sensor  test  encompasses  a  relatively  small  uniform  terrain  area, 
several  well-instrumented  meteorological  towers  may  be  used  instead  of  a  large 
network  of  sensors.  Meteorological  towers  can  be  configured  in  many  ways  to 
meet  the  requirements  of  the  user.  A  complete  station  situated  in  a  remote  area 
typically  includes  a  2-  to  10-meter  mast  on  which  the  temperature,  wind,  pressure, 
humidity,  and  other  sensors  are  moimted.  Other  instruments  such  as  rain  gauges 
and  visibility  devices  are  located  adjacent  to  the  mast.  A  meteorological  tower 
erected  to  support  a  specific  field  test  will  have  instrumentation  at  several 
heights.  For  example,  a  10-meter  tower  will  have  sensors  at  the  2-  and  10-meter 
positions.  Sensors  used  will  depend  on  the  project  requirements  and  equipment 
availability.  In  many  cases,  there  are  likely  to  be  several  towers  ranging  from  2- 
to  32-meter  height. 

Sensor  selection  for  a  meteorological  tower  depends  on  test  data 
requirements  and  desired  derivative  information.  For  example,  if  information  on 
the  transport  direction  of  an  aerosol  cloud  is  required,  a  wind  vane  with  a  speed 
threshold  of  about  1  m/s  is  all  that  is  required.  If  the  objective  is  the 
measurement  of  turbulent  flow  characteristics,  a  threshold  of  about  0.1  m/s  is 
needed.  In  this  case,  a  sensor  such  as  a  sonic  anemometer  coupled  with  hot  wire 
temperature  sensors,  can  supply  the  necessary  information.  In  any  case,  the 
characteristics  of  each  sensor  must  be  known.  Information  such  as  accuracy, 
range  of  sensitivity,  threshold  sensitivity,  and  resolution  are  used  to  describe  these 
characteristics.  Sensor  electrical  parameters  such  as  signal  output  voltage. 
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frequency  range,  and  signal  type  are  important,  so  the  data  acqmsition  system  can 
be  tailored  to  the  device.  Physical  characteristics  such  as  environmental 
limitations,  size,  weight,  and  ruggedness  are  important  to  the  operator.  The 
selection  of  sensors,  therefore,  depends  on  specific  test  requirements. 

Data  collection  procedures  are  similar  for  towers  and  remote  weather 
stations.  They  differ  only  in  the  number  of  channels  that  are  needed,  the  rate  at 
which  the  sensors  are  sampled,  and  the  manner  in  which  the  data  are  transmitted 
to  the  recording  device.  A  remote  station  might  monitor  5  to  10  sensors.  It  may 
use  either  a  self-contained  tape  recorder  or  transmit  data  periodically  over  a  ra^o 
or  telephone  link  to  a  central  recording  facility.  A  meteorological  tower,  on  the 
other  hand,  might  have  dozens  of  sensors  which  are  sampled  periodically  and  the 
data  recorded  and  transmitted  via  a  modem  and  hard  wire  to  a  computer.  In  both 
cases,  the  sensor  signals  are  sent  to  a  data  logger  where  they  are  processed  and 
digitized.  A  commonly  used  data  logger  accepts  sensor  signals  from  either  analog 
or  pulse  sources.  Analog  instrument  outputs  might  include  temperature,  pressure, 
relative  hiunidity,  or  solar  radiation.  Pulse  sources  include  sensors  such  as  wind 
speed  (as  measured  with  a  propeller)  or  precipation  as  measured  with  a  rain 
gauge  fi'om  a  tipping  bucket.  A  well  designed  data  logger  will  accept  up  to  16 
single-ended  or  8  differential  measm-ement  analog  sensors  and  four  pulse  output 
sensors. 

A  well-designed  data  logger  makes  voltage  measurements  by  integrating  the 
input  signal  for  a  fixed  time  and  then  holding  the  integrated  value  for  the  analog 
to  digital  (A/D)  conversion.  Fast  and  slow  integration  times  should  be  available. 

A  typical  logger  digitizing  rate  for  meteorological  data  is  typically  one  per  second. 
Data  are  typically  averaged  by  the  logger  for  1-  or  15-minute  output  periods.  The 
logger  is  programmed  to  output  the  sensor  data  in  engineering  units. 

Two  output  formats  are  typically  available:  one  for  analog  recording  (for 
example,  on  a  cassette  tape  recorder)  and  the  other  is  RS-232  for  transmission  via 
radio  or  telephone  modem  to  a  computer  for  data  storage.  The  final  output 
then  be  stored  on  a  computer  disk  or  other  internal  memory  storage. 


3.3.12.2  Aloft  Meteorological  Measurements.  Aloft  meteorological 
measimements  can  be  divided  into  those  attained  using  sensors  that  operate 
remotely,  and  those  attained  using  sensors  that  are  carried  aloft  and  relay  data 
back  to  a  ground  level  recorder.  Examples  of  remote  meteorological  sensors 
include  the  laser  Doppler  velocimeter  (LDV),  Sonic  Detection  and  Ranging 
(SODAR),  UHF  wind  profilers,  and  Radio  Acoustic  Sounding  Systems.  Examples 
of  systems  that  carry  sensors  aloft  include  balloon  sondes  and  rocketsondes. 

Laser  Doppler  velocimeters  are  mobile  remote  wind  sensing  systems  that 
use  laser  technology  to  make  wind  measurements  at  altitudes  ranging  from  5  to 
1000  meters.  Typical  LDV  systems  use  continuous  wave  (CW)  COj  laser  sources 
operating  at  a  wavelength  of  10.6  pm.  The  light  is  sent  through  output  optics  and 
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deflected  into  the  atmosphere  via  a  rotating  defl  stor,  causing  the  laser  beam  to 
scan  the  atmosphere  conically.  The  measured  velocity  component  is  along  the 
beam  axis.  To  determine  a  three-dimensional  velocity  component  set,  the  beam  is 
swept  about  a  preset  conical  half  angle  (for  example,  45°)  at  rates  of  several  hertz. 
Light  scattered  from  the  measurement  volume  (which  increases  with  tranmission 
range)  is  collected  by  an  optical  recei  9r  and  processed  to  detect  the  Doppler 
frequency  shifts.  For  each  complete  beam  scan,  Doppler  shifts  in  the 
backscattered  signals  received  from  several  hundred  sampling  volumes  aroimd  the 
circular  path  are  processed  to  obtain  a  mean  three-dimensional  wind  field.  Each 
wind  field  measurement  is  time  tagged  and  reported  in  both  graphic  and  tabular 
form  to  include  date,  site,  U-V-W  wind  components,  wind  speed,  wind  direction, 
and  altitude  at  which  the  measurement  was  made.  The  LDV  systems  also  detect 
boundary  layer  altitudes  through  signal  magnitude.  At  the  botmdary  layer, 
aerosol  concentration  decreases  sharply.  The  LDV  signal  magnitude  depends  on 
the  square  root  of  aerosol  number  density.  Thus,  at  the  boundary  layer,  LDV 
signal  magnitude  suffers  a  noticeable  reduction.  The  LDV  systems  are  expensive 
but  not  imcommon  at  test  ranges.  They  represent  a  major  advance  in  the  ability 
to  routinely  and  continuously  sample  aloft  boundary  layer  winds  remotely. 

The  SODARs  measure  wind  speed,  direction,  gmd  echo  intensity  as  a 
fimction  of  altitude.  The  SODAR  fimctions  like  a  pulsed  radar,  but  instead  of  an 
electromagnetic  wave,  it  emits  an  acoustic  wave.  Unlike  an  electromagnetic  wave, 
acoustic  signal  propagation  varies  as  a  fimction  of  atmospheric  temperature.  A 
series  of  acoustic  waves  propagating  outward  through  the  atmosphere  are 
partially  reflected  back  to  the  antenna  as  a  continuous  echo  train  because  of 
small-scale  temperature  fluctuations  along  the  pulse  path.  Altitude  is  derived 
from  the  propagation  rate  (speed  of  sound),  the  elapsed  time  of  the  round  trip,  and 
the  angular  cosine  of  the  antenna. 

Wind  speed  is  derived  from  the  Doppler  shift  encoxmtered  by  the  ptilse  in  a 
dynamic  turbulent  structure.  Thermal  turbulence  is  derived  from  the  amplitude 
of  the  received  signal.  The  SODARs  transmit  acoustic  signals  with  one  vertical 
and  two  tilted  beams.  Typically,  data  are  collected  between  50  and  1000  meters 
height  depending  on  instrument  design. 

The  UHF  wind  profiler  measures  horizontal  and  vertical  wind  as  a  function 
of  altitude.  A  UHF  pulse  Doppler  radar  operating  at  a  frequency  of  915  or 
924  MHz  transmits  signals  at  an  angle  of  15°  from  the  vertical  in  north-south  and 
east-west  directions.  The  radial  wind  velocity,  determined  from  Doppler  shifted 
backscattered  signal  returns  from  turbulent  atmospheric  cells,  is  measured  and 
converted  to  horizontal  wind  components  and  vertical  wind  speed.  The  opposed 
transmission  directions  can  be  in  any  direction,  provided  the  orientation  with 
respect  to  true  north  is  known. 
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The  Radio  Acoustic  Sounding  System  (RASS)  measures  temperatime  profiles 
in  the  lower  troposphere.  It  is  a  specialized  system  developed  at  White  Sands 
Missile  Range.  The  RASS  functions  as  an  auxiliary  system  by  emitting  a  2  kHz 
acoustic  signal  along  with  the  915  MHz  UHF  wind  profiler.  The  zenith  pointing 
radar  and  high  intensity  acoustic  signals  are  transmitted  simultaneously. 
Backscatter  occurs  over  the  altitude  range  where  the  radar  and  acoustic  beams 
overlap.  Doppler  processing  of  the  backscattered  signal  yields  an  acoustic  velocity 
profile  which  is  then  converted  to  a  virtual  temperatime  profile  after  the  effects  of 
air  motion  are  minimized. 

State-of-the-art  tethersonde  systems  measure  temperatm*e,  pressime,  wet 
bulb  depression,  wind  speed,  and  wind  direction  as  a  function  of  altitude  and 
elapsed  time.  The  measurements  are  made  using  a  radiosonde  attached  to  a 
tethered,  helium-filled  balloon.  For  example,  a  well-designed  tethersonde  system 
consists  of  a  winch  powered  by  a  12-V dc  battery  or  commercial  power,  a  tether 
line,  a  radiosonde  powered  by  a  9-Vdc  dry  cell,  the  balloon,  and  a  data  acquisition 
system.  The  sonde  transmits  at  a  radio  frequency  of  403  MHz  and  is  attached  to 
a  carriage  moimted  below  the  balloon.  The  balloon  is  designed  to  align  itself  and 
the  sonde  into  the  wind.  The  horizontal  wind  direction  is  measured  with  a 
magnetic  compass  inside  the  sonde,  and  the  wind  speed  is  measured  by  a  three- 
cup  anemometer  attached  to  the  sonde.  The  altitude  of  the  sonde  above  ground 
level  is  computed  fi'om  the  output  of  an  aneroid  temperature-compensated 
pressime  sensor.  Profiles  of  the  atmosphere  can  be  made  to  approximately  800 
meters  altitude.  Maximum  attainable  altitude  is  limited  by  the  length  of  the 
tether  line  deployed,  air  traffic  concerns,  and  wind  speed.  Higher  wind  speeds 
cause  the  balloon  to  be  carried  out  to  greater  horizontal  distances,  thus  reducing 
the  maximinn  achievable  altitude.  Temperature  can  be  measured  from  the 
teathersonde  with  a  precision  matched  bead  thermistor,  and  the  relative  humidity 
can  be  derived  fi'om  a  wet  bulb  temperatiu'e  depression  measvirement  also  using  a 
precision  matched  thermistor.  Data  fi'om  the  sonde  can  be  telemetered  to  a 
ground  based  receiving  station  which  decodes  the  data,  generates  a  listing  on  a 
line  printer  or  electronic  graphics  display  for  quick-look  review,  and  stores  the 
data  on  computer  disk  or  magnetic  tape  for  future  processing  and  analysis. 

Aloft  meteorological  measiu'ements  to  higher  altitudes  are  accomplished 
with  rawinsondes  and  rocketsondes.  A  state-of-the-art  rawinsonde  set  measiu'es 
temperature,  pressure,  relative  hiunidity,  wind  speed,  and  wind  direction  from  the 
smface  to  30  km  altitude.  A  commercially  available  system  uses  a  fi'ee-flight 
balloon  with  attached  radiosonde,  which  performs  the  in-situ  measurement  of 
temperatizre,  pressure,  and  relative  hiunidity.  The  radiosonde  may  also  contain 
either  a  LORAN  or  OMEGA  receiver,  which  permits  the  calculation  of  sonde 
horizontal  position  as  the  balloon  drifts  with  the  wind.  The  differential  position, 
coupled  with  the  pressure-height  measiu-ement,  permits  the  calculation  of  wind 
speed  and  direction  as  a  function  of  altitude.  All  data  are  transmitted  to  a  ground 
receiving  and  processing  station  via  a  403  MHz  radio  link. 
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A  second  technique  used  with  firee-flight  balloons  employs  a  radio  theodolite 
for  balloon  tracking.  This  system  measures  atmospheric  temperature,  pressure, 
relative  htunidity,  wind  speed,  and  wind  direction.  A  commercially  available  radio 
theodolite  system  consists  of  a  helium-fiUed  fi*ee-flight  balloon  with  an  attached 
radiosonde,  a  pedestal  mounted  tracking  antenna,  and  a  receiving  station  to 
decode,  process,  and  store  data.  The  theodolite  antenna  automatically  tracks  the 
radiosonde  transmitter  on  the  free  floating  balloon  and  measures  the  pedestal 
azimuth  and  elevation  angles.  The  system  can  track  the  transmitter  for  up  to 
150  km  slant  range  distance  with  direct  line  of  sight.  The  altitude  of  the  sonde 
above  groimd  level  is  computed  from  an  onboard  pressure  transducer.  The  spatied 
position  of  the  sonde  is  computed  from  the  azimuth,  elevation,  and  altitude  data, 
and  the  wind  speed  and  direction  are  computed  from  the  differential  position  as  a 
function  of  time.  Temperature  is  measured  using  a  bead  thermistor,  and  relative 
humidity  is  detected  with  a  carbon  hygristor.  The  sonde  data  are  transmitted  via 
1680  MHz  radio  frequency  to  the  radio  theodolite  receiver  and  then  to  the 
recording  and  processing  system.  A  computer  performs  preliminary  processing, 
generates  a  quick-look  report,  and  stores  the  data  on  magnetic  tape  for  future 
processing  and  analysis. 

A  commercially  developed  small  rocketsonde  system  makes  possible  the  very 
rapid  measurement  of  aloft  meteorological  parameters.  This  rocketsonde  uses  a 
model  rocket  to  carry  precision  temperature/humidty  and  pressure  probes  aloft.  A 
unique  satellite  global  positioning  system  (GPS)  gives  the  rocket  coordinates 
continuously  with  an  error  of  less  than  1.5  m.  Information  from  the  onboard 
instnunents  is  telemetered  to  a  ground  station  that  acquires  and  displays  the  data 
using  a  personal  computer. 


2.3.13  Air  Temperature.  Humidity,  and  Pressure.  Air  temperature, 
humidity,  and  pressure  are  fundamental  parameters  required  to  characterize  the 
performance  of  virtually  any  electro-optical  sensor  in  the  atmospheric  bmmdary 
layer.  Major  advances  have  been  made  during  the  past  10  years  in  the  ability  to 
measime  these  parameters.  Thin  film  technology  makes  available  instruments 
having  fast  response  and  sensitivity.  For  example,  an  RH  sensor  that  uses  a  2  pm 
thick  polymer  film  has  a  0-100  percent  RH  range  for  operating  temperature 
between  -40  to  +  60  °C,  a  0.5  second  response  time,  and  is  accurate  to  ±2  percent 
at  25  °C.  A  barometer  covering  a  range  of  1100  to  600  mb  (-700  to  4200  m 
altitude)  with  an  accuracy  of  ±  0.5  mb  and  a  resolution  of  0.1  mb  (1  m  altitude)  is 
operable  at  temperatiires  between  -25  to  +  50  °C. 

Accuracy  and  resolution  requirements  for  these  measurements  will  depend 
on  the  iiltimate  use  of  the  data  in  evaluating  electro-optical  sensor  performance. 

As  is  shown  in  the  next  section,  instrument  accuracy  and  resolution  of 
fundamental  parameters  are  major  contributors  to  &e  error  associated  with  the 
characterization  of  the  tested  sensor. 


2-59 


2.4  TEST  DATA  EVALUATION 


Test  data  evaluation  is  one  of  the  most  important  and  the  least  applied 
areas  in  electro-optical  sensor  atmospheric  test  and  evaluation.  Test  data 
evaluation  procedures  define  data  quality  and  reliability.  Using  these  procedures, 
data  can  be  assigned  a  relative  measurement  error,  and  the  uncertainty  of  sensor 
performance  or  model  being  evaluated  can  be  quantified.  In  this  part,  methods  to 
evaluate  and  assign  measurement  errors  are  reviewed.  The  impact  of 
measurement  error  on  sensor  performance  is  then  considered  through  examples 
for  a  visual  and  infrared  imaging  system  and  for  laser  rangefinder  system 
performance.  It  is  shown  that  production  of  a  prescribed  instrument  accuracy  can 
be  insufficient  for  sensor  evaluation  requirements  or  may  be  too  restrictive.  In 
conducting  experimental  evaluations  of  sensor  performance,  the  test  engineer  and 
the  system  developer  must  have  a  clear  xmderstanding  of  the  measurement 
accuracy  required  to  achieve  an  acceptable  evaluation  of  system  performance. 


2.4.1  Root-Mean-Square  Errors.  Since  it  is  impossible  to  test  the  sensor  under 
every  possible  field  condition,  it  is  assumed  all  sensors  use  a  model  to  predict 
performance  under  most  meteorological  conditions,  and  the  objective  of  the  test 
and  evaluation  process  is  a  calibration  check  on  the  reliability  of  the  model 
relative  to  actual  sensor  performance.  It  is  further  assumed  the  model  is  a 
"perfect"  physical  representation  of  the  sensor.  Considering  only  the  effects  of 
accuracy  of  input  parameters  on  prediction  capability,  three  questions  are 
addressed  that  must  be  answered  to  evaluate  sensor  model  performance  prediction 
capability.  These  questions  are 

1.  What  are  the  effects  of  model  input  uncertainty  on  model  prediction 
uncertainty? 

2.  What  are  tJie  major  parameters  that  affect  model  prediction  \mcertainty? 

3.  How  accurate  must  input  data  be  for  a  required  level  of  model  prediction? 


To  provide  answers  to  these  questions,  the  following  assumptions  are  made: 

1.  Measured  model  inputs  are  independently  determined. 

2.  Each  parametric  uncertainty  is  a  small  fraction  of  the  value  of  the 
corresponding  observed  variable. 

3.  Positive  and  negative  errors  are  equally  likely  to  occur. 

4.  Root-mean-square  (rms)  error  represents  measured  vmcertainty. 
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This  part  considers  the  computation  of  rms  error  for  evaluating  the  effects  of  the 
quality  of  experimental  data  on  specifying  sensor  capability. 

Assume  a  function  f(x^,  where  Xi  represents  the  defining  parameters  of  the 
function.  The  rms  error  of  f(x^  is 


^(<8/  ix^>f  = 
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If  Gaussian  statistics  are  assumed  (the  errors  are  random),  then  Sxj  is  the 
standard  deviation  evaluated  at  the  mean  value  of  Xj,  <x{>,  and  the  probability  of 
exceeding  the  rms  error  is  31.73  percent  and  the  probable  error  is  0.6745  times 
the  rms  error  (ref  36).  Thus,  the  functional  error  components  may  be  treated  as  a 
vector  with  components  that  are  computed  according  to 
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The  relative  error  for  each  functional  component  is 
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Therefore,  the  rms  relative  error  is 
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If  f(x)  represents  an  electro-optical  sensor  performance  model,  and  x^  are  the 
functional  parameters  affecting  sensor  performance,  the  relative  uncertainty  in 
model  performance  can  be  evaluated  by  (1)  computing  first  derivatives  of  model 
performance  with  respect  to  the  functional  parameters;  (2)  measuring  the 
peu'ameter  X,  and  its  corresponding  relative  error,  bxjxi;  and  (3)  using  the  results 
in  equation  2-13.  Note,  that  if  is  itself  determined  by  a  set  of  independent 
measurements,  say  y,,  then  equation  2-13  is  applied  to  find  the  resulting  error  for 
the  parameter  by  replacing  f(x)  with  x^,  and  Xj  with  yj. 

The  use  of  equation  2-13  requires  test  planning  that  will  allow  the 
functional  parsuneters  to  be  measured  a  sufficient  number  of  times  to  compute  a 
reliable  standard  deviation  for  the  measurement,  and  the  measiirement  must  be 
completed  under  conditions  where  the  mean  value  of  the  parameter  is  constant 
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(statistically  stable).  As  is  shown  in  the  next  subparagraphs,  when  this 
information  is  not  provided  with  the  measured  data,  little  is  actually  known  about 
sensor  performance.  As  equations  2-11  to  2-13  show,  the  relative  rms  uncertainty 
in  the  function  of  interest  is  proportional  to  the  differential  change  in  the  function 
with  respect  to  the  change  in  the  measured  variable.  The  error  in  extrapolated 
values,  therefore,  depends  on  the  slope  of  the  function  at  the  extrapolated  point  for 
which  the  data  are  acqvdred.  If  the  functional  slope  is  less  than  1,  the  effect  of 
data  errors  at  the  measured  point  decreases  at  the  extrapolated  point.  If  the 
functional  slope  is  greater  than  1,  the  effect  of  data  errors  at  the  measured  point 
increases  at  the  extrapolated  point.  It  is  important  in  determining  acceptable 
data  error  limits  to  understand  the  application  of  the  data  and  to  specify  the 
measured  data  error  and  precision. 


2.4.2  Impact  Of  Measurement  Error  On  Sensor  Evaluation.  To  illustrate 
the  impact  of  measmement  errors  on  sensor  evaluation,  measurements  for  three 
sensor  types  are  considered  in  the  subparagraphs  that  follow.  First,  the 
probability  of  successful  target  detection  and  ranging  is  considered  for  visual  and 
infrared  imaging  systems,  and  the  probability  of  successful  ranging  for  1.06  and 
10.6  pm  wavelength  laser  systems  is  considered.  Examples  of  meteorological 
effects  on  the  relative  uncertainty  of  atmospheric  transmission  for  broad  band 
infrared  and  narrow  band  millimeter  wave  systems  are  then  considered.  The 
effects  of  spatial  and  temporal  samphng  intervals  are  then  considered  in  the 
context  of  point  sensor  sampling  networks  and  other  meteorological  variables. 


2.4.2. 1  Target  Detection  Amd  Ranging.  Table  2-1  provides  a  summary  of  the 
atmospheric  environmental  measurements  required  to  evaluate  electro-optical 
systems  used  to  detect,  recognize,  or  range  targets.  To  illustrate  the  impact  of 
measimement  errors  in  the  evaluation  of  electro-optical  sensors  performing  these 
functions,  relative  measurement  errors  for  selected  sensor  examples  have  been 
used  to  compute  the  relative  uncertainty  in  the  corresponding  sensor  function. 

The  examples  are 

•  relative  imcertainty  in  visual  50  percent  probability  of  detection, 

•  relative  imcertainty  in  infrared  (thermal  bands)  50  percent  probability  of 
detection, 

•  relative  imcertainty  in  1.06  and  10.6  pm  laser  wavelength  probabihty 
of  successful  ranging, 

•  relative  uncertainty  in  1.06  and  10.6  pm  laser  wavelength  laser 
power  on  target, 

•  relative  uncertainty  in  broad  band  infrared  transmission,  and 

•  relative  uncertainty  in  millimeter  wave  extinction  and  transmission. 


The  results  of  the  computations  are  presented  in  appendixes  B  through  G, 
which  show  the  relative  uncertainty  of  sensor  performance  as  functions  of  key 
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measurements  affecting  sensor  response.  The  relative  errors  diosen  for  inputs 
into  the  models  used  to  compute  the  results  are  arbitrarily  chosen  but  are 
reasonable  and  attainable  values. 

Results  of  the  sensor  performance  relative  uncertainty  computations  shown 
in  appendixes  B  through  G  dearly  demonstrate  that  a  single  acceptable  error 
value  for  a  measurement  does  not  provide  suffident  guidance  for  the  accuracy  of 
sensor  evaluation  measiirement.  Suppose,  for  example,  that  determination  of  the 
visual  50  percent  probability  of  detection  (first  figure  in  appendix  B)  was  required 
for  the  sensor  under  evaluation.  Assume  further  that  for  the  chosen  target-to- 
backgroimd  senario,  the  relative  transmittance  required  for  50  percent  probability 
of  detection  is  such  that  relative  (to  a  nonattenuating  atmosphere)  atmospheric 
transmittance  needs  to  be  0.5.  In  this  case,  if  the  sky-to-groimd  ratio  is  20  (sky 
much  brighter  than  the  groimd),  the  relative  uncertainty  in  50  percent  probability 
of  detection  is  about  6.5  percent  even  though  relative  imcertainties  in  target 
inherent  contrast,  sky-to-ground  ratio,  and  relative  transmittance  to  the  target  are 
all  10  percent.  However,  if  the  sky-to-ground  ratio  is  about  1,  then  the  relative 
uncertainty  in  50  percent  probability  of  detection  is  about  40  percent  for  the  same 
relative  measxirement  uncertainties  when  the  sky-to-ground  ratio  was  20.  It  is 
important  to  choose  acceptable  measurement  error  levels  on  the  basis  of  how 
accurately  sensor  performance  must  be  quantified. 

As  the  figures  in  appendixes  B  through  G  are  examined,  it  should  become 
clear  that  the  Target  Atmosphere  Sensor  Synopsis  relationships  discussed  in 
paragraph  2  are  evident.  For  example,  the  thermal  band  50  percent  probability  of 
detection  relative  uncertainty  shown  in  appendix  C  depends  on  the  FLIR 
minimum  resolvable  temperature  difference  (MRTD)  relative  uncertainty,  while 
the  50  percent  probability  of  successful  ranging  depends  on  the  transmitter 
aperttire  diameter,  pulse  width,  number  of  range  gates,  and  the  relative 
uncertainty  in  measured  atmospheric  parameters.  Sensor  operating 
characteristics  contribute  to  the  definition  of  the  accuracy  required  for  parameters 
used  to  characterize  the  atmosphere.  The  test  engineer  should  keep  an  accurate 
log  of  the  operating  characteristics  of  the  sensor  under  test. 


2.4^.2  Broad  And  Narrow  Band  Transmission.  A  second  set  of  examples 
have  been  computed  to  illustrate  the  impact  of  atmospheric  measiu’ement 
iincertainty  on  quantifying  sensor  performance,  broad  band  infrared  transmission, 
and  narrow  band  millimeter  wave  tremsmission  relative  uncertainty.  The 
computations  have  been  developed  as  fimctions  of  relative  uncertainty  in  input 
parameters  required  by  empirical  transmission  models.  The  infi'ared  broad  band 
transmission  was  computed  using  a  model  developed  by  Analytics,  Inc.  in  1985 
(ref  37). 

Millimeter  wave  transmittance  was  computed  using  the  Beer-Bouguer 
transmission  law  and  extinction  cross-section  computations  were  made  using  the 
complex  dielectric  constant  for  water  and  ice  as  a  fimction  of  temperatime  given  by 
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Sadiku  (ref  23).  The  results  of  these  computations  are  given  in  appendix  D, 
Results  similar  to  those  observed  for  the  probabilities  of  detection  and  ranging  in 
the  previous  section  are  shown  in  appendix  D  and  serve  to  reinforce  conclusions 
concerning  required  measxirement  accuracy. 


2.4.3  Temporal  and  Spatial  Averaging  Intervals.  How  data  will  be  averaged 
temporally  and  spatially  to  evaluate  electro-optical  sensor  performance  is  a  major 
issue  that  must  be  addressed  during  test  design  and  used  as  a  guiding  principle 
during  data  acquisition  and  analysis.  There  are  numerous  references  that 
describe  protocols  to  follow  in  determining  meas\irement  sensor  spacing  in  a 
sensor  network  and  data  acquisition  rates  to  ensure  statistically  stable  data  and 
data  that  can  have  specified  accuracy  and  relative  xmcertainty  (ref  16,  38,  39,  40). 
These  references  should  be  consulted  when  networks  are  used.  However,  a 
guiding  principle  should  be  to  use  path-integrated  measurement  techniques  along 
the  same  line  of  sight  as  the  sensor  under  test  whenever  possible.  The 
measurement  fine  of  sight  should  be  within  at  least  one  correlation  length  (see 
subparagraph  2.3.7)  of  test  article  line  of  sight.  It  should  be  sampled  at  least 
twice  as  fast  as  the  highest  fi*equency  of  the  phenomena  measmed.  If  point 
sensors  are  used  along  the  line  of  sight,  each  sensor  should  be  within  a  correlation 
length  of  the  other.  It  is  to  be  emphasized  that  the  size  of  the  correlation  length 
may  vary  down  the  fine  of  sight  and  can  easily  be  a  fimction  of  atmospheric 
conditions.  Tests  designed  under  consideration  of  particular  atmospheric 
conditions  must  be  reconsidered  in  terms  of  point  sensor  placement  when  factors 
affecting  correlation  length  change. 

Whenever  possible  and  reasonable,  statistical  regression  and  probability 
distribution  analysis  of  the  data  should  be  used  to  produce  mean  values  and 
standard  deviations  that  can  be  understood  in  terms  of  sensor  performance 
without  resorting  to  explictly  computing  parametric  averages.  For  example, 
regression  of  visible  range  against  logarithmic  infrared  transmission  should  yield 
(for  constant  air  temperature  and  relative  humidity)  a  nearly  linear  relationship 
with  a  slope  proportional  to  the  extinction  characteristics  of  the  intervening 
atmosphere.  The  best  fit  line  to  the  data  is  the  mean  value  of  the  measurements 
and  does  not  directly  average  the  data  temporally  or  spatially.  The  resulting 
correlation  coefficient  is  proportional  to  the  standard  deviations  of  both  sets  of 
data.  The  data  analysis  performed  in  this  way  automatically  yields  the  extra 
dividends  of  defining  the  atmospheric  extinction  properties,  providing  a 
relationship  between  the  infrared  transmission  and  visible  range  can  be  checked 
by  other  experimental  and  theoretical  means,  and  providing  analytical 
relationships  can  be  used  directly  in  the  evaluation  of  the  electro-optical  sensor. 

All  are  achieved  without  directly  performing  temporal  or  spatial  averages  of  the 
data.  Data  averaging  should  be  approached  with  the  intent  of  extracting  as  much 
information  about  the  sensor  evaluation  and  data  itself  as  possible. 
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2.6  DATA  AND  INFORMATION  BASES 


A  key  factor  in  test  design  and  data  evaluation  is  data  and  information 
accessibility.  Prom  the  beginning  of  test  design  and  planning,  how  the  data  will 
be  archived  and  used  must  be  considered  both  directly  for  the  sensor  evaluation 
and  for  potential  future  applications.  Digital  data  acquisition  is  standard  practice. 
Software  for  relational  digital  data  bases  is  common  and  sufficiently  standardized 
that  data  can  be  imported  and  exported  easily  among  systems.  Therefore,  it  is 
taken  as  axiomatic,  that  although  there  are  still  analog  instruments  and  recording 
systems  in  use,  the  data  will  be  in  digital  form  and  will  be  archived  in  data  base 
formats. 

Test  design  and  planning  should  identify  the  data  base  in  which  the  test 
data  will  be  archived.  By  identifying  the  data  base,  reqmsite  formats  for  variable 
measurements  already  included  in  the  data  base  are  available  to  guide  data 
acqmsition  formats.  In  the  case  where  no  archival  data  base  can  be  identified 
prior  to  the  test,  the  data  should  as  a  minimum  be  formatted  in  ASCII  code. 

In  the  subparagraphs  that  follow,  a  clear  distinction  is  drawn  between  data 
bases  and  information  bases.  Data  bases  are  defined  as  archival  records  of 
qualified  parametric  measurements  and  dociimentation  to  support  their  use  and 
interpretation  (for  example,  specification  of  accuracy,  instrument  used  in  the 
measurement,  and  synoptic  acquisition  conditions).  Information  bases  are 
archived  records  of  results  obtained  with  the  data.  These  results  might  include, 
for  example,  analysis  reports  with  the  data  used  in  the  report,  model  predictions 
using  measured  parameters  as  inputs,  results  of  data  analysis  that  yield 
regression  relationships,  or  characteristic  electro-optical  sensor  responses  for  the 
ranges  of  parameters  covered  in  the  data  base.  Data  base  and  information  base 
recommendations  to  support  electro-optical  sensor  test  and  eveduation  are 
addressed  next. 


2.5.1  Data  Archival  Formats  And  Storage.  The  most  popular  form  of  digitized 
data  media  for  field  apphcations  are  floppy  disks  that  can  hold  several  megab3i;es 
of  data  through  disk  compression  programs.  Blocked  records  with  a  header 
containing  data  and  supporting  information  should  be  used  for  archived  data.  The 
header  should  contain  aU  information  pertinent  to  the  test  with  the  exception  of 
drawings  and  photographs.  In  facilities  where  CD-ROM  can  be  written  and  read, 
drawings,  weather  charts,  maps,  and  photographs  should  be  included  as  a  normal 
part  of  the  data  file.  The  header  information  should  include  at  least  the  following 
information: 

1.  date  of  the  measurement 

2.  time  basis  (UTC,  local) 

3.  test  facility 

4.  reports  in  which  the  measurements  are  used 

5.  primary  author 
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6.  classification 

7.  point  of  contact  for  the  measurements 

8.  lead  sponsoring  agency 

9.  test  range  weather  (meteorological  and  specific  line  of  sight) 

10.  types  and  kinds  of  meteorological  observations  (requirement  sources  and 
specific  applications) 

11.  data  validity  concerns  (cross-checks  as  data  were  acquired) 

12.  target  configurations  (contrasts,  d3mamic  characteristics,  locations) 

13.  number  and  types  of  measurement  sensors 

14.  sensor  response  characteristics  (dynamic  range,  response  time, 
calibration  history  and  method,  accuracy  capability  with  caveats) 

15.  definition  of  least  significant  digit  in  data 

16.  data  averaging  interval  as  appropriate 

17.  site  survey  (locations  of  instrumentation  to  include  height  above  ground, 
targets,  and  significant  terrain  features,  located  with  ±  0.5  m 
imcertainty) 

18.  test  variables  measured  (formats,  units,  applications,  method  of  cross¬ 
checks) 

19.  sample  of  data  record  with  "plain  Enghsh"  interpretation 

Archived  data  shoiild  be  qualified  and  organized  according  to 

1.  measurements  specifying  the  same  parameter  located  by  a  common  file 
reference  in  a  common  format  and  in  chronological  order, 

2.  SI  units  or  powers  of  10  variations,  and 

3.  mean  values  of  measured  quantities  over  time  periods  commensurate 
with  statistically  stable  data  (10  minutes  running  average  for 
meteorological,  1  minute  running  average  for  SWOE  data,  1  second 
for  smokes/obscurants),  standard  deviations,  regression  or  statistical 
distribution  summaries  and  correlation  coefficients,  and  when 
networks  are  used  to  provide  Hne-of-sight  predictions,  the  prediction 
or  interpolation  algorithm  employed  for  intepreting  the  data. 


2.5.2  Information  Base  Generation  And  Storage.  Information  bases  t3q)ically 
reside  in  the  same  physical  location  as  the  archived  data;  however,  it  is  accessible 
independently  and  is  referenced  and  identified  as  the  information  base  for  the 
archived  data.  The  information  base  contains  a  directory  of  content  files,  a 
"HELP"  file,  and  all  the  tools  (word  processors,  spreadsheets,  graphics  software, 
models  used  as  analysis  tools,  and  project  planners/schedulers)  necessary  to  access 
and  use  the  information  that  is  archived  in  any  of  the  information  manipulation 
formats.  It  should  be  clear  that  information  bases  are  a  direct  result  of  test 
customer  feedback  to  the  data  production  source.  To  produce  total  quality  data, 
the  producer  must  have  a  clear  imderstanding  of  how  data  are  used.  Storing 
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customer  applications  with  identification  of  the  data  the  customer  used  and  how 
the  data  were  manipulated  for  the  analysis  or  evaluation  provides  a  logical 
repository  of  all  information  pertinent  to  the  sensor,  and  provides  a  historical  data 
basis  for  improvement  in  future  testing. 


2.6.3  Identifying  And  Reporting  Data  Gaos.  It  is  a  fiscal  and  physical 
impossibility  to  test  an  electro-optical  sensor  under  all  meteorological  conditions  of 
its  operating  envelope.  It  is  important  that  an  information  base  be  maintained 
identifying  gaps  in  the  data  and  information  base  pertinent  to  sensor  performance 
or  evaluation  requirements.  As  new  tests  are  designed,  it  is  possible  to  include 
within  the  test  framework  opportunities  to  secure  data  that  are  otherwise 
overlooked  for  lack  of  identification  of  requirements.  Maintenance  of  an 
information  base  that  identifies  the  range  limits  and  application  limitations  of 
previously  acquired  data  provides  a  dear  picture  of  standard  test  needs, 
extraordinary  test  requirements,  and  acquired  data  limitations. 


2.5.4  Identifying  And  Tracking  Future  Test  Requirements.  An  information 
base  identifying  developmental  items  and  their  projected  test  schedules  assists  in 
planning  test  range  usage  and  projecting  hardware  requirements.  This  tracking 
system  need  not  be  complicated.  Commercially  available  project  tracking  software 
is  suffident  to  provide  the  guidance  needed  for  planning  and  future  test  design  to 
pmsue  total  quality  data  management. 
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APPENDIX  A 


SUMMAKY  OF  ATMOSPHERIC  ENVIRONMENTAL 
PARAMETER  REQUIREMENTS 
IN  SUPPORT  OF 

ELECTRO-OPTICAL  SYSTEMS  TESTING 


A-l 


1.0  Piirpose 


These  tables  were  prepared  with  the  cooperation  and  assistance  of  the  RCC 
Meteorology  Group  Subcommittee  for  Electro-Optics  to  provide  an  overview  of  the 
test  variables  and  parameters  needed  to  evaluate  electro-optical  sensors  in  the 
atmosphere. 


2.0  Scope 

Seven  types  of  tests,  in  two  categories,  are  presented.  The  first  test 
category  covers  generic  tests  for  imaging  systems,  laser  range  finders,  and 
millimeter  wave  sensors.  The  second  test  category  involves  specific  ongoing  test 
programs  that  normally  include  electro-optical  sensors  operating  in  the 
atmosphere.  These  tests  are  for 

1.  visual  image  sensors, 

2.  infi-ared  image  sensors, 

3.  laser  range  finders, 

4.  millimeter  wave  sensors, 

5.  the  Smart  Weapon  Operational  Enhancement  (SWOE)  program, 

6.  the  Smoke  Week  test  program,  and 

7.  littoral  warfare  test  programs. 

As  many  as  40  variables  are  listed  in  the  tables.  The  variables  are  ranked 
in  importance  on  a  scale  of  1  to  3.  A  rank  of  1  is  considered  fundamental  to  the 
specification  of  sensor  performance  and  must  be  measured  for  determination  of 
sensor  performance.  A  rank  of  2  shows  that  the  variable  is  desirable  and  perhaps 
fundamentally  necessary  if  sensor  performance  in  scenarios  not  covered  by  test 
conditions  is  to  be  determined.  A  rank  of  3  indicates  the  variable  is  of  secondary 
importance  for  directly  evaluating  sensor  performance,  but  is  likely  to  provide 
information  to  help  explain  anomalous  sensor  performance. 
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TABLE  A-1 .  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  ELECTRO-OPTICAL  VISUAL  IMAGE  DETECTION  TESTING 
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20  Dew/Frost  Feature  signatures 

21  Target/background  emissivity _ Feature  signatures _ 

22  Relative  Humidity  Structure  Const. _ m**‘2/3 _ Beamspread/Scintiiiation 

23  State  of  surface  Environment  characterization 


TABLE  A-1  (Confd).  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  ELECTRO-OPTICAL  VISUAL  IMAGE  DETECTION  TESTING 


7  K 

5  O  ^  8^ 

£  K  °  ° 
lij  0^  uS  u!> 
O  Ul 
O 
< 


uS  i/> 


o  o 


■8  8  8 


© 

> 

c 

© 

> 

J© 

o 

© 

© 

o 

TO 

o 

c 

ffi 

ZJ 

c 

m 

°  n  c 
1  C  " 

III 
I  I  I 

O  ^  O 

CO  P  CO 


^  I  ^ 

i  c  ■§ 
S  8  ° 
F  w  o 


□  <D 

S° 

ffi  13  C 

o  .2 

fl>  «  "2 


2.  TO  c 

£  I  I 

«  E  5 


O  O 

S’  S’ 

■D  -O 


C  Cc»  — 

=  ©  =  O  TO 

©  O  O  C  C 

i  £  i  ^  .2 


£  1  s.  « 

'5  »  TO  « 

>  cc 


a  1  s 


.5  Q.  £ 

R  8  8- 

I  I  E 

a  "  5 


A-4 


q:  (D 

LU  z 
^  LU 


gs 

li 

UJ  Q 
O  U-l 


<  i= 

q:  O 

<  6 

3  O 
CO  lU 

CN  LU 

<9. 


CD  01 

<  o 


g  ^  ^  g 

n  K  ^  ^  o 

u]  0^  w  ? 


^  jZ  SP 

in  g  to 


ooooooooo 


§  S  C 

S  S  o 

1^1 

#1%  m\  ^ 


III  II 


c  c  £  ^ 
UJ  LU  <  < 


„  I  - 

8  3  g 
S  -52  J 

i  i  1 1 1 

^  ^  10  a>  ^ 

8  8  C  I  S 

m  n  ^  'to 

1  1  I  I 

i  ?  I  1 

^  ^  *®  o  2 

^  I  2  =5  *1 

i  I  5  3  8 

i  g  «  «  c 

S  S  £  S  I 


^  I  g  I 


J2  iS  JS I  J5 

3  3  3  3 


Ills 

i  1 1  1  I 
1 1  €  i  i 

1  f  H  3  f 


I  8  8  8  8  8 


§  §  §  § 

(Q  (0  CO  (Q 

£  £  £ 

E  E  E  E 

«0  «  CO  CO 

C  C  C  C 

2  2  2  2 

I-  H  I-  I- 


r  ^  ^ 

I  8  I  ' 

1  8  5  c 

S  I  I 

“  E  -i  8 

2  E  2  p 

2  g  2  g 

(0  S  CO  c 

0)  2  01  m 


c  5 

CO  £ 

£  3 
*1  E  C 
g  N  -2 
N  ?  5 

CO  CO  CM 


Q>  £ 

te  «  5 


■S  2  2 

111 


20  Dew/Frost  Feature  signatures 

21  Target/background  emissivity _ Feature  signatures _ 

22  Relative  Humidity  Structure  Const. _ m**’2/3 _ Beamspread/Scintillation 

23  State  of  surface  Environment  characterization 


TABLE  A-3.  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  ELECTRO-OPTICAL  LASER  RANGEFINDER/DESIGNATOR  TESTING 
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24  Sea  state  Environment  characterization 


TABLE  A-3  (Cont'd).  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  ELECTRO-OPTICAL  LASER  RANGEFINDER/DESIGNATOR  TESTING 
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atmospheric  layer  Transmittance  calculation 

39  Dew  point  temperature  for  each  degC  Humidity  calculation  60  2  2  1  1  1  05 

atmospheric  layer  Rain  temperature  calculation 

40  Atmospheric  pressure  for  each  mbar  Transmittance  calculation  60  2  2  1  10%  10%  10% 

atmospheric  layer _ _ _ Downwelling  Irradiance  level 
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TABLE  A-5.  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  SWOE  PROGRAM  ELECTRO-OPTICAL  SYSTEMS  SIMULATIONS 


19  Sea  state  Environment  chatacteilzation 


TABLE  A-5  (Cont'd).  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  SWOE  PROGRAM  ELECTRO-OPTICAL  SYSTEMS  SIMULATIONS 
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TABLE  A-6.  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  SMOKE  WEEK  TEST  PROGRAM  ELECTRO-OPTICAL  SYSTEMS  TESTING 


?  o  ^  ?  U 

rt  K  T3  ^  O 
UJ  0^  CN  2 


I  ^ 

in  g  to 


O  .E 
1  E 
o  a 

OOOOOOOOO^ 


^  <U  0) 

8  S  ^ 


.E  D  *6  -o 

^  I  I  I 


<D  JS  ^ 
§  3  C 

«  -  o 

III 

111 
?  I  I 

ill 

5*  c  *5 
:  1 1 
2  -3  I 

«  Ji  c 


■O’?* 

.2^33333 

isisssss 

ll'SSSSSS 

<!»a^*cCCCCC 
^  ID  IQ  to  A  IQ  10 

g  *%££££££ 

2S-§S-EEEEE 

82:a|gggg» 


8  -a  ® 

i  «  S 

f  3  3 

-S?  m 


£  S  O  5* 
E  g  *1  £ 

g  a  «  3 

I  8  i  s 

H  ii.  i:  Li. 


^  ^  I 


0)  ^ 
£  §s  o 
JQ  5 


^ 

I  I  g 

w  O  -D 


CO  CO  CM  Q. 


^  CM  «  V 


--  D.  *0 

0)  flj  r 

±J  5  - 

«  CO 

a  a 

o  ^ 

'€  tr  c 

£  I 


s  e  8 
it  ^  i 


3  © 

O  2  o 

o»  E  a 

0-^3 
m  ^  <0 


K  tr  CO  CO 


in  *0  K  «  oj  2 


CJ|  CO  M#*  ^ 


A-13 


TABLE  A-6  (Cont'd).  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  SMOKE  WEEK  TEST  PROGRAM  ELECTRO-OPTICAL  SYSTEMS  TESTING 
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TABLE  A-7.  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  LITTORAL  WARFARE  TEST  PROGRAM  ELECTRO-OPTICAL  SYSTEMS  TESTING 
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TABLE  A-7  (Cont'd).  SUMMARY  ATMOSPHERIC  ENVIROMENTAL  PARAMETERS 
IN  SUPPORT  OF  LITTORAL  WARFARE  TEST  PROGRAM  ELECTRO-OPTICAL  SYSTEMS  TESTING 
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APPENDIX  B 

RELATIVE  UNCERTAINTY  IN  VISUAL 
50  PERCENT  PROBABILITY  OF  DETECTION 


B-l 


1.0  Purpose 


Appendix  B  demonstrates  the  impact  of  meteorologic  meastirement 
uncertainty  on  the  evaluation  of  visueJ  imaging  sensors. 


2.0  Scope 

The  50  percent  probability  of  detection  is  taken  as  the  data  application. 

The  primary  parameters  affecting  probability  of  detection  with  a  visual  imager  are 
the  inherent  contrast  of  the  target,  the  contrast  threshold  of  the  sensor,  relative 
(to  no  attenuation)  atmospheric  transmittance,  target  range  and  size,  visual  and 
sensor  response  to  contrast,  and  path  luminance  which  is  defined  in  terms  of  the 
ratio  of  sky  illuminance  to  background  illuminance.  Figure  B-1  shows  the  relative 
imcertainty  in  the  50  percent  probability  of  detection  as  a  function  of  relative 
atmospheric  transmittance  for  selected  values  of  the  sky-to-ground  ratio.  A 
sky-to-ground  ratio  of  1  corresponds  to  the  Koschmieder  transmittance  for  visual 
range.  Figure  B-1  can  be  interpreted  as  defining  the  transmittance  required  to 
reduce  target  probability  of  detection  to  50  percent  for  a  fixed  ratio  of  inherent 
target  contrast  to  threshold  contrast.  As  the  inherent  contrast  approaches  the 
threshold  contrast,  less  attentuation  (higher  levels  of  transmittance)  is  required  to 
reduce  the  probability  of  detection.  As  the  inherent  contrast  increases  relative 
threshold  contrast,  increased  attenuation  (lower  values  of  transmittance)  is 
required  to  reduce  the  probability  of  detection.  Figure  B-2  shows  information 
similar  to  that  in  figure  B-1  except  that  the  relative  transmission  axis  has  been 
written  in  terms  of  the  ratio  of  target  to  visual  range.  Figures  B-3  to  B-5  show 
the  impact  of  sky-to-ground  ratio  for  a  range  of  inherent  contrast  to  threshold 
contrast  values. 
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Relative  uncertainty  in  visual  50  percent  probability  of  detection  as  a  function  of 
atmospheric  transmittance  and  sky-to-ground  ratio. 


RELATIVE  UNCERTAINTY  IN  INHERENT  CONTRAST:  0.1 
RELATIVE  UNCERTAINTY  IN  SKY-TO-GROUND  RATIO:  0.1 
RELATIVE  UNCERTAINTY  IN  TRANSMITTANCE:  0.1 
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VISUAL  50%  PROBABILITY  OF  DETECTION  RELATIVE  UNCERTAINTY 
RELATIVE  UNCERTAINTY  IN  SKY-TO-GROUND  RATIO-  0  05 
RELATIVE  UNCERTAINTY  IN  INHERENT  CONTRAST;  0.05 


Figure  B-3.  Relative  uncertainty  in  visual  50  percent  probability  of  detection  as  a  function  of  and 
sky-to-ground  ratio  for  increasing  target  contrast  relative  to  threshold  contrast 
for  5  percent  uncertainty  in  inherent  contrast  and  sky  to  ground  ratio. 


VISUAL  50%  PROBABILITY  OF  DETECTION  RELATIVE  UNCERTAINTY 
RELATIVE  UNCERTAINTY  IN  SKY-TO-GROUND  RATIO'  0  1 
RELATIVE  UNCERTAINTY  IN  INHERENT  CONTRAST'  0  1 
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Figure  B-4.  Relative  uncertainty  in  visual  50  percent  probability  of  detection  as  a  function  of  and 
sky-to-groimd  ratio  for  increasing  target  contrast  relative  to  threshold  contrast  for  10 
percent  uncertainty  in  inherent  contrast  and  sky  to  groimd  ratio. 


VISUAL  50%  PROBABILITY  OF  DETECTION  RELATIVE  UNCERTAINTY 
RELATIVE  UNCERTAINTY  IN  SKY-TO-GROUND  RATIO:  0.2 
RELATIVE  UNCERTAINTY  IN  INHERENT  CONTRAST:  0.2 


Figure  B-5.  Relative  uncertainty  in  visual  50  percent  probability  of  detection  as  a  function  of  and 
sky-to-ground  ratio  for  increasing  target  contrast  relative  to  threshold  contrast  for  10 
percent  imcertainty  in  inherent  contrast  and  sky  to  ground  ratio. 


APPENDIX  C 


RELATIVE  UNCERTAINTY  IN  INFRARED 
(THERMAL  BANDS) 

50  PERCENT  PROBABELITY  OF  DETECTION 


1.0  Purpose 


Appendix  C  demonstrates  the  impact  of  meteorologic  measurement 
uncertainty  on  the  evaluation  of  infrared  imaging  sensors. 


2.0  Scope 

The  50  percent  probability  of  detection  for  an  8-12  pm  band  FLIR  is  taken 
as  the  data  application.  The  primary  parameters  affecting  the  probability  of 
detection  are  the  target-background  thermal  contrast,  the  absolute  magnitude  of 
the  thermal  irradiance  (which  is  a  function  of  thermodynamic  temperature),  target 
size  and  range,  atmospheric  attenuation,  target  and  backgroimd  spectral 
emissivities,  and  the  minimxim  resolvable  temperature  difference  (MRTD)  of  the 
sensor.  Figm*e  C-1  shows  the  relative  uncertainty  in  the  50  percent  probability  of 
detection  as  a  function  of  atmospheric  transmittance  for  selected  target  ranges. 

The  transmittance  can  be  interpreted  as  the  transmittance  required  to  reduce 
target  probability  of  detection  to  50  percent  for  a  fixed  ratio  of  target-to- 
background  thermal  contrast  to  MRTD  which  is  the  infi*ared  analog  to  that  shown 
in  appendix  B  for  figure  B-1.  The  MRTD  is  assumed  to  be  that  for  a  commonly 
used  military  FLER.  Figure  C-2  shows  the  variation  in  relative  uncertainty  as  a 
function  of  background  temperature.  Figure  C-3  plots  the  relative  uncertainty  in 
brightness  temperature  as  a  function  of  uncertainty  in  thermodynamic 
temperature  difference  for  selected  values  of  relative  uncertainty  in  the 
target/background  emissivity  ratio. 
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RELATIVE  UNCERTAINTY  INPUTS: 
TRANSMITTANCE:  10% 

EMISSIVITIES:  10% 

THERMODYNAMIC  TEMPERATURES:  0  5% 
MRTD:  5% 
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Figure  C-1.  Relative  uncertainty  in  8-12  ^m  band  50  percent  probability  of  detection  as  a  function  of 
relative  transmittance  and  increasing  target  range  for  27  ®C  ambient  temperature,  3  K 
target-to-background  thermal  contrast,  and  0,98  target  emissivity,  and  0.9  background 
emissivity. 


Figure  C-2.  Relative  uncertainty  in  8-12  pm  band  50  percent  probability  of  detection  as  a  function  of 

ambient  temperature  and  increasing  relative  uncertainty  in  transmittance  for  27  ®C  ambient 
temperature,  3  K  target-to-background  thermal  contrast,  and  0.98  target  emissivity,  and 
0.9  background  emissivity. 


AMBIENT  TEMPERATURE:  20C 
TARGET  EMISSIVITY:  0.98 
BACKGROUND  EMISSIVITY:  0.9 
MEAN  BAND  WAVELENGTH:  10um 
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_ thermodynamic  temperature  difference _ _ 

P'igur6  C“3.  H.6l3.tiv6  uncortsinty  in  8-12  bnnd  brightness  temperature  difference  as  a  function 
of  relative  uncertainty  in  target-to-background  thermodynamic  temperature  difference 
for  values  of  relative  uncertainty  in  the  ratio  of  target-to-background  emissivities. 


APPENDIX  D 


RELATIVE  UNCERTAINTY  IN  1.06  AND  10.6  jam 
LASER  WAVELENGTH 
PROBABILITY  OF  SUCCESSFUL  RANGING 
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1.0  Purpose 


Appendix  D  demonstrates  the  impact  of  meteorologic  measurement 
uncertainty  on  the  evaluation  of  laser  range  finders/designators. 


2.0  Scope 

The  50  percent  probability  of  successful  ranging  for  1.06  and  10.6  pm  laser 
wavelengths  is  taken  as  the  data  application.  Once  the  system  operating 
characteristics  (laser  power,  pulse  width,  nximber  of  range  gates,  transmitter  beam 
size,  and  receiver  aperture  diameter)  are  established,  the  primary  atmospheric 
factors  affecting  LRF  performance  are  refractive  timbulence  and  relative 
transmittance.  Figures  D-1  to  D-8  show  the  relative  xmcertainty  in  successful 
ranging  as  a  function  the  index  of  refraction  structure  constant  for  an  LRF  that 
has  operating  parameters  normally  found  in  military  systems.  The  apparent  plot 
discontinuities  in  figures  D-1  to  D-4  for  1.06  pm  LRF  wavelengths  arise  because  of 
changes  in  the  equations  for  the  Strehl  ratio  when  the  inner  turbulence  scale 
exceeds  three  times  the  transmitting  apertiire  size.  Note  that  the  refractive 
turbiilence  has  a  much  stronger  effect  at  the  shorter  wavelength  than  for  the 
longer  wavelength. 
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Figure  D-1.  Relative  uncertainty  in  50  percent  probability  of  successful  ranging  for  a  1.06  pm  wavelength 
LRF  with  7  cm  diameter  circular  aperture  as  a  function  of  refractive  index  turbulence 
structure  constant,  ,  and  range  to  target  for  10  percent  relative  uncertaintv  in  Cm* 
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Figure  D-2.  Relative  uncertainty  in  50  percent  probability  of  successful  ranging  for  a  1.06  pm 

wavelength  LRF  with  7  cm  diameter  circular  aperture  as  a  function  of  refractive  index 
turbidence  structure  constant,  ,  and  range  to  target  for  20  percent  relative  uncertainty 
in  Cn  and  5  percent  relative  imcertainty  in  transmission. 


LASER  WAVELENGTH I  1.0  Sum 
TRANSMITTER  DIAMETER;  7 Cl 
LASER  PULSE  WIDTH;  10ns 
NUMBER  OF  RANGE  GATES;  1 
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uncertainty  in  and  5  percent  relative  uncertainty  in  transmission. 
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Figure  D-5.  Relative  uncertainty  in  50  percent  probability  of  successful  ranging  for  a  10.6  pm 

wavelength  LRP  with  7  cm  diameter  circular  apertme  as  a  function  of  refractive  index 
turbulence  structure  constant,  CN^  and  range  to  target  for  10  percent  relative 
uncertainty  in  and  6  percent  relative  imcertainty  in  transmission. 


TRANSMITTER  DIAMETER:  7 cm 

LASER  PULSE  WIDTH:  lOns 

NUMBER  OF  RANGE  GATES:  1 

RELATIVE  UNCERTAINTY  IN  Cn"2:  20% 

RELATIVE  UNCERTAINTY  IN  TRANSMISSION:  5 
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Figtire  D-7.  Relative  uncertainty  in  50  percent  probability  of  successful  ranging  for  a  10.6  pm 

wavelength  LRF  with  7  cm  diameter  circular  aperture  as  a  function  of  refractive  index 
turbulence  structure  constant,  CN^  and  range  to  target  for  50  percent  relative 
uncertainty  in  and  5  percent  relative  uncertainty  in  transmission. 
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Figure  D-8.  Relative  uncertainty  in  50  percent  probability  of  successful  ranging  for  a  10.6  pm 

wavelength  LRF  with  7  cm  diameter  circular  aperture  as  a  function  of  refractive  index 
turbulence  structme  constant,  ,  and  range  to  target  for  100  percent  relative 
uncertainty  in  and  5  percent  relative  uncertainty  in  transmission. 


APPENDIX  E 

RELATIVE  UNCERTAINTY  IN  1.06  AND  10.6  jmi  LASER 
WAVELENGTH  LASER  POWER  ON  TARGET 
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1.0  Purpose 


Appendix  E  demonstrates  the  impact  of  meteorologic  measurement 
uncertainty  on  the  evaluation  of  the  amount  of  power  that  directed  energy  devices 
such  as  laser  range  finders  and  designators  can  deliver  to  a  target. 


2.0  Scope 

A  major  effect  of  refractive  turbulence  on  directed  energy  devices  such  as 
laser  range  finders  is  to  spread  the  transmitted  beam  to  a  size  much  greater  than 
predicted  by  diffraction  limited  design  performance.  As  a  result,  target 
illumination  may  decrease  because  the  incident  beam  overfills  the  target,  signal 
return  is  decreased  because  less  power  is  delivered  to  the  target,  and  mean  target 
reflectivity  is  reduced  because  the  entire  target  is  involved  in  the  signal  return. 
The  relative  imcertainty  in  power  delivered  to  a  target  through  a  turbulent 
atmosphere  is  a  major  contributor  to  the  relative  imcertainty  in  the  probability  of 
successful  ranging  as  illustrated  in  appendix  D.  The  results  presented  here  are 
applicable  to  any  electro-optical  directed  energy  device  as  long  as  propagation  is 
linear  (atmospheric  thermal  heating  and  blooming  effects  are  not  considered). 
Transmission  of  1.06  and  10.6  pm  wavelength  radiation  is  considered  here  as 
function  of  target  range  and  relative  imcertainty  in  the  index  of  refraction 
turbulence  structure  constant. 
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LASER  WAVELENGTH:  1.0 6um 
RANGE  TO  TARGET:  1km 
TRANSMITTER  DIAMETER:  7cm 
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LASER  WAVELENGTH :  1.0  6um 
RANGE  TO  TARGET:  2km 
TRANSMITTER  DIAMETER:  7cm 
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LASER  WAVELENGTH:  1.0 6um 
RANGE  TO  TARGET:  3km 
TRANSMITTER  DIAMETER:  7cm 
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LASER  WAVELENGTH :  1.0  6um 
RANGE  TO  TARGET:  4km 
TRANSMITTER  DIAMETER:  7cm 
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Figure  E-5.  Relative  uncertainty  in  1.06  pm  wavelength  power  delivered  to  a  target  for  a  7  cm 

transmitter  aperture  diameter  and  5  km  target  range  as  a  function  of  index  of  refraction 
structure  constant  and  selected  relative  uncertainties  in  the  structure  constant. 
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LASER  WAVELENGTH:  10 . 6um 
RANGE  TO  TARGET:  2  km 
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Figure  E-7.  Relative  uncertainty  in  10.6  jim  wavelength  power  delivered  to  a  target  for  a  7  cm 

transmitter  apertme  diameter  and  2  km  target  range  as  a  function  of  index  of  refraction 
structime  constant  and  selected  relative  uncertainties  in  the  structure  constant. 
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Figure  E-9.  Relative  uncertainty  in  10.6  pim  wavelength  power  delivered  to  a  target  for  a  7  cm 

transmitter  aperture  diameter  and  4  km  target  range  as  a  fimction  of  index  of  refraction 
structure  constant  and  selected  relative  uncertainties  in  the  structure  constant. 
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APPENDIX  F 


RELATIVE  UNCERTAINTY  IN  8-12  iim  TRANSMITTANCE 
BECAUSE  OF  AJR  TEMPERATURE,  RELATIVE  HUMIDITY, 

AND  VISUAL  RANGE 


1.0  Piirpose 


Appendix  F  demonstrates  the  impact  of  meteorologic  measxirement 
uncertainty  on  the  evaluation  of  the  8-12  pm  band  irradiance  transmitted  in  the 
atmosphere. 


2.0  Scope 

Water  vapor  and  aerosol  scattering  are  the  primary  mechanisms  for 
extinction  of  8-12  pm  band  irradiance  in  the  atmosphere.  The  8-12  pm  band  is 
the  primary  operational  band  for  electro-optical  sensors  that  are  used  as  night 
vision  devices  or  to  extend  operational  capabiUty  in  atmospheric  hazes.  The 
meteorologic  parameters  used  to  characterize  extinction  are  air  temperature, 
relative  humidity,  and  visual  range.  Results  can  also  be  applied  to  directed 
energy  sensor  evaluation.  Figure  F-1  plots  the  relative  (no  extinction)  8-12  pm 
band  irradiance  transmittance  as  a  function  of  slant  range  for  selected  values  of 
visual  range  (a  measm*e  of  aerosol  loading)  and  air  temperature  of  20  °C  and 
relative  humidity  of  80  percent  (a  measure  of  water  vapor  content).  Figure  F-2 
fixes  the  aerosol  content  at  a  visual  range  of  4  km  and  varies  the  water  vapor 
content  for  a  fixed  relative  humidity  by  plotting  selected  values  of  air  temperature. 
Figures  F-3  through  F-12  plot  the  relative  uncertainty  in  transmittance  as  a 
function  of  slant  range  for  selected  atmospheric  conditions  by  individually 
considering  the  relative  imcertainty  contributions  of  temperatxire,  relative 
humidity,  visibihty,  and  the  root-mean-square  sum  of  the  contributions.  All 
analysis  presented  here  assumes  the  spectral  response  of  the  thermal  imager  is 
independent  of  wavelength. 
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AIR  TEMPERATURE,  K:  293 
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ATMOSPHERIC  CONDITIONS  RELATIVE  UNCERTAINTIES 
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Figure  F-11.  Relative  uncertainty  in  8-12  |im  band  averaged  transmittance  as  a  function  of  slant  range 
for  40  ®C  air  temperature,  70  percent  relative  humidity,  and  5  km  visual  range.  Relative 
uncertainty  in  air  temperature  is  1.19  percent,  in  relative  humidity  is  5  percent,  and  in 
visual  range  is  10  percent. 
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APPENDIX  G 


RELATIVE  UNCERTAINTY  IN  MILLIMETER  WAVE 
EXTINCTION  AND  TRANSMITTANCE  PARAMETERS 
AS  A  FUNCTION  OF  ICE  AND  LIQUID 
WATER  PRECIPITATION  TEMPERATURES 


G-1 


1.0  Purpose 


Appendix  G  demonstrates  the  impact  of  meteorologic  measurement 
uncertainty  on  the  evaluation  of  millimeter  wave  extinction  as  a  function  of  ice 
and  hquid  water  precipitation  temperature. 


2.0  Scope 

The  temperatures  of  water  and  ice  affect  the  dielectric  constant  used  to 
compute  millimeter  wave  extinction.  The  Debye  model  of  the  dielectric  constants 
for  water  and  ice  have  been  used  to  compute  the  relative  uncertainty  in 
parametric  values  associated  with  millimeter  wave  transmission. 
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Figure  G-3.  Relative  uncertainty  in  the  imaginary  component  of  the  dielectric  constant  as  a  function  of 
frequency  and  liquid  water  temperature  for  a  0.5  “C  uncertainty. 
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Figure  G-4.  Relative  uncertainty  in  relative  transmission  (with  respect  to  no  extinction)  for  35  Ghz  and 
95  Ghz  millimeter  wave  propagation  for  a  0.5  °C  uncertainty  in  LWC  temperature,  10  "C 
temperature,  and  5  percent  relative  uncertainty  in  LWC. 
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Figure  G-6.  Relative  uncertainty  in  the  imaginary  component  of  the  dielectric  constant  of  ice  as  a  function 
of  frequency,  -2  °C  ice  temperature,  and  a  0.5  °C  uncertainty.  The  relative  uncertainty  in  the 
real  component  of  the  dielectric  constant  for  these  variables  does  not  exceed  0.00001  percent. 
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